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CHAPTER  I 
HISTORICAL  BACKGROUND  OF  THE  STUDY 


Purpose  and  Limitations 

Ever  since  schools  departed  from  the  tutorial  method 
and  became  more  or  .less  dependent  upon  the  textbook  as  the 
tool  most  readily  used  in  education,  the  problem  of  select- 
ing the  best  reading  materials  from  a  number  of  inferior 
or  mediocre  books  offered  has  been  manifest. 

The  purpose  therefore  of  this  study  is  to  discover 
who  the  educators  are  who  have  recognized  this  problem  and 
what  means  they  have  chosen  to  solve  it.    As  far  as  is 
possible  this  study  will  attempt  to  trace  the  development 
of  this  problera  from  the  time  it  first  became  apparent  until 
the  present.     To  do  this  efficiently  the  study  will  be 
divided  into  three  periods:     (1)  Previous  to  and  during 
1920  to  1929;   (2)  1930  to  1939;  (3)  1939  until  the  present. 

This  study  is  limited  in  that  it  is  based  on  research 
mainly  into  the  writings  of  others  and  attempts  only  to 
set  forth  their  findings.     Much- of  the  material  presented 
will  consist  of  adaptation  or  direct  quotation  accompanied 
by  criticisms  or  conclusions.     In  order  to  discover  what 
literature  was  already  available  the  following  were  con- 
sulted:    Card  catalogues  of  Boston  University  School  of 

Education  Library  and  the  Boston  Public  Library;   also  the 
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following  publications:     Education  Index,  Periodicals 
Directory.  Reader' s  Guide  to  Periodical  Literature, 
Cumulative  Book  Index,  and  the  United  States  Catalogue . 

Historical  Background 

At  this  point  it  might  "oe  advisable  to  briefly  trace 
the  history  of  the  textbook  as  adapted  from  Kall-^uest  — ^ 
to  show  how  the  need  for  evaluation  has  arisen. 

In  the  educational  systems  of  ancient  ii^gyot,  Babylon, 
Assyria  or  Israel  there  were  no  available  textbooks  for 
individuals.    Also  in  Greece  and  Rome  it  is  unlikely  that 
each  pupil  possessed  a  textbook  of  his  own.  However 
toward  the  end  of  the  twelfth  century  individual  manuscripts 
were  not  uncommon.     They  consisted  of  Greek  and  Latin 
treatises  and  their  contents  were  memorized  in  entirety. 

The  Renaissance  textbooks  were  similar  to  those  of  the 

preceding  age.     But  at  this  time  many  new  books  began  to 

appear.     The  printing  press  made  it  possible  to  produce 

books  more  quickly,  more  cheaply  and  in  larger  numbers. 

As  theology  was  the  outstanding  subject  studied  in  that  era, 

Melancthon,  a  Renaissance  writer  and  teacher,  claimed  that 

the  knov;ledge  of  Latin  was  indispensable.     His  "Latin 

Grammar"  written  to  supply  that  knowledge  received  the 

following  comment  from  Schenck,^  an  early  German  teacher: 

1/  Alfred  Lawrence  Hall-'^uest,  The  Textbook,  Kow  to  Use  and 
Judge  It.     The  Macmillan  Company,  Nev/  York,  1913,  p.  14-40. 

2/  Ibid,  p.  18  as  quoted  from  Barnard,  German  Teachers  and 
Educators .     Brovm  and  Gross,  Publishers;  187S,  p.  173« 


This  little  book  has  now  attained  to  that  per- 
fection that  there  appears  to  be  nothing  deficient 
in  it,  nor  can  there  hereafter  be  anything  added  to 
it;  and  accordingly  it  will  ever  continue  to  be  as 
it  is  now,  the  sum  of  all  perfection,  neither  to  be 
altered  or  remodeled. 

"Between  1525  and  172?  it  passed  through  fifty-one 
editions,  each  more  or, less  altered  from  the  original. 

,,1/ 

Strictly  speaking  the  modern  textbook  is  little 
more  than  three  hundred  years  old.     Only  within  the 
last  seventy-five  years  has  it  become  more  adequately 
adapted  to  the  laws  of  the  learning  procass  and  there 
are  still  needs  of  a  better  adaptation,^ 

In  the  early  days  of  colonial  America  the  alphabet  was 
the  beginning  of  knowledge.     Attempts  at  grading  were  very 
indefinite.     The  pupils  were  first  required  to  learn  letters. 
After  mastering  these  they  were  exposed  to  simple  syllables, 
which  were  followed  by  more  difficult  syllables.     The  read- 
ing materials  which  v/ere  eventually  provided  consisted  of 
religious  doctrines. 

The  first  attempt  to  break  away  from  the  narrow, 
biased,  religious  concept  of  education  appeared  in  the  form 
of  "spelling  books." 

A  reading  book  written  by  Noan  ..ebstdr  v/as  published 
in  1785  which  contained  stories  about  the  heroes  of  the 
Revolutionary  iVar,  Indian  wars  snl  other  ancient  stories. 
Previous  to  this  time  the  Bible  ana  various  kinds  of  homiles 
served  as  bases  for  instruction  in  reading.     However  the 
1/  Alfred  Lawrence  Hall-^uest,  op.   cit.  p.  18. 
2/  Ibid.  p.  20. 
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little  reading  book  v?as  well  received  and  from  the  stand- 
point of  variety  of  subject  matter  it  was  greatly  advanced 
over  any  material  of  its  kind  in  those  days. 

G-rammars  began  to  appear  between  I58O  and  159^,  but 
it  wasn't  until  1329  that  a  grammar  designed  for  young 
students  was  published.     It  v.-as  called  "The  Little 
Grammarian. " 

Arithmetics  were  uncommon  among  the  early  colonists. 

When  the  subject  was  taught  in  1729  it  was  taught  from  a 

manuscript.     This  was  provided  only  for  the  teacher  who 

dictated  the  examples  v/hich  the  pupils  wrote  in  their 

"sum-books."    An  early  textbook  was  written  by  Nicholas  Pike 

and  was  published  about  17o8.     In  this  many  of  the  problems 

dealt  with  contemporary  history,  as  for  example:  "G-eneral 

♦Vashington  was  born  in  1732;  what  v^as  his  a&.e  in  1787?"^ 

G-eography  v/as  not  taught  in  the  elementary  schools 
before  the  Revolution.     In  the  more  advanced  schools 
some  rudimentary  instruction  was  given  in  this  subject. 
At  first  G-eography  was  used  as  reading  material  but 
slowly  it  won  an  independent  place. 2/ 

"Before  1821  no  satisfactory  history  of  the  United 
States  had  appeared.     The  following  year,  1822,  C.  A.  Good- 
rich published  'A  History  of  the  Unite!  States'    ....  In 
many  respects  it  v/as  an  excellent  piece  of  work."^ 

During  the  period  immediately  preceding  the  Civil  War 

1/  Alfred  Lav/rence  Hall-^uest,  op.   cit.  p.  51. 
2/  Ibid.  p.  34. 
3/  Ibid.  p.  36. 
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it  was  noticed  that  large  numbers  of  pupils  of  approximately 

the  same  attainments  were  crowding  the  schools.     This  made 

possible  a  grading  of  the  children  into  units  through  which 

they  advanced  annually/  or  semi-annually  by  promotion.  The 

tendency  toward  an  eight  year  elementary  school  followed 

by  four  years  of  secondary  education  was  developing  and  by 

1890  the  most  common  arrangement  of  the  city  schools  in 

the  United  States  was  the  so-called  8-4  plan. 

The  factor  of  gradation,  v^ith  each  class  under  a 
single  teacher,  gave  a  great  deal  more  time  for  the 
treatment  of  the  stated  school  subjects  and  even  in- 
vited the  addition  of  new  subjects  ....  The  traditional 
reading,  spelling,  writing,  and  arithmetic  continued 
alongside  the  newer  subjects,  geography,  grammar  and 
United  States  History.     In  many  elementary  schools 
were  to  be  found  also  some  or  many  of  the  following: 
'object-teaching,  singing,  drav;ing,  gymnastics,  vocal 
culture,  English  literature,  natural  history,  physics, 
history  of  England,  algebra,  metric  system,  physical 
geography,  physiology  (including  anatomy  and  hygiene), 
geometry  and  mensuration,  bookkeeping,  astronomy,  the 
German  Language,  Constitution  of  the  United  States, 


Y/ith  the  gradation  of  the  school  system  came  more 
exacting  courses  of  study  which  outmoded  many  of  the  then 
popular  textbooks.     The  publishers  refusing  to  allow  their 


arithmetics,  spellers,  readers  and  other  school  fcooks 
corresponding  to  the  exact  classification  of  the  pupils 
and  meeting  the  expanded  demands  of  instruction. 


17    Edward  H.  Reisner,  The  Evolution  of  the  Cod.u<ju  joxiool 
The  Macmillan  Company,  Kevv  YorK,  1535,  p.  425^  includint, 
a  quotation  from:  John  D.  Philbrick,  City  School  Sy steais 
in  the  United  States ,  U.  3.  Bureau  of  Education,  Circular 
of  Information,  No.  1,  I8S5,  p.  5I. 


material  to  become  obsolete  began  to  present  "series"  of 


The  series  of  readers  Ijegan  with  a  primer  and 
progressed  through  first  rea-ier  to  sixth.  Arithmetics 
v/ere  produced  in  at  least  three  grades  of  difficult^' 
and  in  the  matter  of  histories,  geographies,  and 
language  lessons  there  v/as  a  corresponding  effort 
to  produce  school  works  specifically  related  to  the 
graded  vdemands  of  the  course  of  study.!/ 


Conclusion 

According  to  present  day  standards  many  of  the  early 
reading  materials  would  earn  a  very  low  rating.     As  a  whole 
they  were  extremely  poor  specimens  of  what  textbooks  should 
be.     They  were  badly  bound,  miserably  printed  on  paper  of 
inferior  quality  and  for  many  students  presented  insurmount- 
able vocabulary  difficulties.     However  they  were  a  begin- 
ning and  in  the  case  of  some  problems  in  the  Colonial 
mathematics  texts,  they  did  show  a  trend  tov/s'rl  adaptation 
to  the  needs  of  the  community. 

One  obstacle  to  the  harmony  of  teaching  in  the  early 
Colonial  schools  arose  in  the  practice  of  each  pupil 
purchasing  his  own  books  without  taking  class  uniformity 
into  consideration.     Although  this  practice  did  provide 
for  much  individual  attention,   it  was  a  factor  in  retarding 
educational  advancement  during  that  period. 

As  our  country  grew,   so  its  educational  system 
developed  until  it  became  at  the  close  of  the  Civil  <var 
Period  almost  a  school-machine  with  every  action  regimented. 
It  v/as  at  this  time  that  gradation  of  reading  materials 
1/  Edward  K.  Reisner,  op,   cit.  p.  426. 


was  "begun  in  earnest,  but  by  the  publishers,  wholly  for 
business  reasons  and  in  a.  manner  not  too  satisfactory  to 
the  educators. 

In  the  early  nineteen  hundreds  a  movement  'was  begun: 
(1)  To  set  up  standards  for  textbooks  to  be  used  in  the 
schools  and  (2)  To  provide  objective  bases  for  evaluating 
reading  materials  already  published. 

In  Chapter  II  many  of  these  methods  of  evaluation 
will  be  described. 


CHAPTER  II 


S/ETHODS  OF  EVALUATION 


Previous  To  and  During  1920  to  1929 


Early  studies  in  criteria  for  .iudp.inp;  reading 
materials . —  One  of  the  earliest  educational  pioneers 
in  the  evaluation  and  selection  of  reading  materials 
was  Dr.  C.  R.  I«/laxwell /  Dean  of  the  College  of  Education, 
University  of  V/yoming. 

As  early  as  1919  he  was  aware  that  the  present  day 
standards  for  the  selection  of  school  reading  materials 
were  very  low  and  at  that  time  made  pertinent  suggestions 
for  their  improvement. 

He  found  that  school  texts  were  being  selected  upon 
the  following  bases: 


1.  Prestige  of  the  author 

2.  Prestige  of  the  publisher 

3.  Efficiency  of  the  book  salesman 

4.  Appearance  of  the  book 

5.  Wide  uae  of  a  text 

6.  Cost  y 


It  would  not  be  difficult  even  for  an  uninformed 

person  to  observe  many  opportunities  for  error  in  the 

above  system.     The  prestige  of  the  author  does  not  infer 

1  /  C.  R»  Maxwell,  "The  Selection  of  Textbooks,"  School 
and  Society  (January  11,  1919)  9:  p.  44-52. 

2/    Loc.  cit. 
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that  he  is  capable  of  adapting  hla  materials  to  the  ability 
of  his  readers,  nor  does  the  prestige  of  the  publisher 
(reputation,  ability. to  meet  financial  obligations)  always 
mean  that  he  publishes  the  best  books.     The  efficiency  of 
the  salesmen  should  not  be  unduly  noticed  yet  it  is  this 
factor  alone  which  has  sold  many  texts  which  would  not 
have  been  purchased  were  their  merits  alone  being  Judged. 
The  appearance  of  a  text  can  be  very  deceptive,  whereas 
its  wide  use  may  be  due  to  previous  high  pressure  sales- 
manship technique,  and  were  the  schools  using  a  certain 
text  given  an  opportunity  to  change,  many  would  probably 
not  even  consider  the  book  they  were  using.     Of  course 
cost  has  always  been  an  influential  item  in  saddling 
schools  with  Inferior  texts,  v/hen  one  or  tv/o  cents  more 
per  copy  might  have  provided  more  worth  while  reading 
materials , 

Dr.  Alaxv/ell  1/  suggests  that  if  the  following  "broad 
underlying  principles"  are  applied  in  selecting  reading 
materials,   "one  of  the  ills  of  the  school  system  has  been 
remedied  if  not  entirely  corrected:" 

1.  It  must  be  taken  into  consideration  that 
there  is  a  difference  in  the  ideals  of  the 
persons  responsible  for  the  work  in  a  school 
system.     The  persons  in  one  system  may  be 
working  along  a  definite  line,  and  their 
energy  is  focused  toward  accomplishing  the 
ends  that  are  set  up.     The  text  should  be 
examined  with  this  ideal  in  viev/. 

2.  An  exhaustive  examination  should  be  made  by 
a  competent  committee. 

1/  C.  R.  Liaxwell,  op.   cit.  p.  48. 
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a.  From  the  standpoint  of  accuracy  and 
reliability. 

b.  From  the  standpoint  of  v/hether  or  not 
relative  values  have  been  given  sufficient 
consideration. 

3.  The  comuiittee  who  make  selections  should  be 
composed  both  of  the  administrators  of  the 
school  system  and  of  the  teachers  v^ho  use  the 
books  in  the  classroom. 

4.  The  book  should  be  written  by  an  author  who 
has  a  broad  knowledge  of  his  field;  v/ho  has 
adequate  knowledge  of  the  particular  aspects 
of  the  work  he  is  treating  and  who  has  had 
experience  in  teaching  students  at  the  stage 
of  advancement  for  which  the  text  is  intended. 

5.  Books  need  to  be  examined  in  the  light  of 
elements  common  to  all  books  as: 
Mechanical  construction,  appearance,  binding, 
size  of  type,  length  of  lines,  illustrations. 
These  are  all  Important  factors,  and  in 
addition  to  them,   the  text  should  be  analyzed 
from  the  standpoint  of  its  value  in  the 
subject  which  it  covers. 

6.  It  should  be  selected  wholly  upon  the  worth 
of  the  book  in  the  particular  situation  for 
which  it  is  chosen,   irrespective  of  prestige 
of  author  or  publisher.—/ 

Many  other  standards  and  principles  are  set  forth  in 
Hall-'iuest        but  they  are  so  similar  to  those  already 
given  that  they  will  not  be  discussed ' further  here. 

Following  the  method  of  evaluating,  by  applying  broad, 
educational  principles  to  the  texts  has  come  the  more 
simplified  method  of  applying  a  check  list. 

One  of  the  earliest  of  these,   an  "Outline  Aid  for 

Judging  All  Books"  which  appeared  in  a  monograph  published 

by  Dr.  Maxwell  in  1921  is  presented  in  the  following  pages. 
1/  Maxv/ell,  op .   cit.  p.  51-52. 


2/  Hall-^iuest,  op.   cit.   Chapters  III,   IV  and  VII. 
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Outline  Aid  for  Judging  All  Texts.  \J 

Excellent 

G-ood 

Fair 

Poor 

I.  Publication 

1.  Title 

2.  Authors: 

A.  Reputation. 

B.  Authority. 

C.  Other  writings. 

3.  Publisher: 

A.  Reputation 

B.  General 
experience . 

C.  Experience  in 
this  field. 

4.  Date  of  copyright: 

A.  First  edition. 

B.  Revised  edition, 
if  any. 

II.  Mechanical  construc- 
tion: 

1.  Size: 

A.  Size  of  page. 

B.  Number  of  pages. 

2.  Shape. 

3.  Binding: 

A.  Paper 

B.  Cloth. 

C.  Board. 

D.  Leather. 

E.  Durability. 

F.  Attractiveness. 

1/  C.  R.  ivlaxwell,  The  Select! 
Mifflin  Company,   Boston,  1 

on  of  Textb 
921,  p.  78- 

ooks . 
83. 

Houghtc 

)n 
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Outline  Aid  (continued) 

Excellent 

G-ood 

Fair 

Poor 

4.  Covers: 

A.  Color. 

B.  Decoration. 

5.  Paper. 

A.  Finish: 

a.  Plain. 

b.  Gloss. 

c.  Dull. 

d.  Tinted, 

B.  Fiber: 

a.  Heavy. 

b.  Thin. 

C.  Filled. 

6.  Type: 

A.  Kind. 

B.  Size. 

C.  Conform  to  the 
needs  of  different 
ages  to  avoid  eye- 
strain. 

7«.  Spacing: 

A.  Letters. 

B.  ««ords. 

C.  Lines: 

a.  Length  -  in 

accordance  with 

psychological 

investigation. 

D.  Paragraphs. 

8.  V/idth  of  margins. 

III.  Content: 

1.  Meet  needs  of  user 
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Outline  Aid  (continued) 

Excellent 

G-ood 

Fair 

Poor 

2.  Purpose  of  author: 

A.  Indicated  by 
preface . 

B.  Developed  in  "book. 

C.  Consistent  point 
of  view, 

3.  Exact  scholarship. 

4.  Vocabulary: 

A.  Within  compre- 
hension of 
students . 

B.  Many  new  words 
introduced  in 
each  assignment. 

5.  Style:  clear,  lucid. 

6.  Treatment  of  topics 
in  proportion  to 
their  importance. 

7.  General  treatment 
or  particular 
phase  of  subject. 

8.  Organization. 

9.  Aids  in  use: 
A.  Index. 

E.  Table  of  contents. 

G.  References: 

a.  Selection. 

b.  Representative 
or  chosen  with- 
out regard  to 
value • 

D.  Illustrations 

a.  Number. 

b.  Representative. 

k 
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Outline  Aid  (concluded) 

Excellent 

Good 

Fair 

Poor 

0.  Clear. 

d.  Purposeful. 

£•  Maps,  charts,  dia- 
grams ,  and  graphs : 

a.  Use. 

b.  Value. 

F.  Suggestions  as  to 
methods  of  treat- 
ment : 

a.  Teacher's  man- 
ual . 

"b.  Suggestions  in 
text. 

IV.  Use: 

1.  G-rades  to  which  best 
ad8,pted. 

2.  Adapted  to  course  of 
study. 

3.  Basic  text. 

4.  Supplementary  text. 

5.  Reference. 

6.  Source  material. 

?•  Teacher's  handbook. 

In  this  monograph  many  other  similar  outlines  are 
presented  to  be  used  in  rating  separate  elementary  school 
subjects,  such  as  reading,  arithmetic,  spelling,  language, 
geography,  history,  drawing,  music  and  penmanship;  also 
some  secondary-school  subjects  as,   civics,   algebra,  geometry, 
science  and  foreign  languages. 
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In  1923  Dr.  John  (}uy  Fowlkes,  Assistant  Professor 
of  Education  at  the  University  of  Vvisconsin,  after  read- 
ing extensively  on  the  subject  of  methods  used  in  the 
selection  of  reading  materials,  made  the  follov/ing  comment: 

The  work  of  Dr.  Maxv/ell  is  worthy  of  the  highest 
praise.     While  Dr.  Maxwell  has  not  resorted  to  a 
statistical  treatment  of  the  study,  he  has  recognized 
that  there  are  certain  criteria  that  should  be  applied 
to  all  books  proposed  as  school  texts.     He,  as  did 
Dr.  Hall-;iuest,  has  also  shown  that  there  is  a  good 
deal  of  variance  between  different  texts  in  relation 
to  the  general  standards.     Dr.  I£ax?/ell  has  opened  the 
way  for  the  development  of  a  general  score  card -for 
reviewing  and  evaluating  all  school  textbooks. 

Dr.  Fowlkes  however,  wished  to  go  beyond  the  simple 
check  list  offered  by  Maxwell,  and  prepare  a  form  which 
contained  not  only  objective  data,  but  also  the  subjective 
opinion  of  the  person  evaluating  the  textbook.     3o  in  1923 
he  published  a  pamphlet  entitled,  "Evaluating  School- 
Textbooks."     In  this  pamphlet  charts  are  provided  for  record- 
ing such  objective  data  as  the  training  and  educational 
experience  of  the  author,  the  proportional  distribution 
of  the  subject  matter,  the  proportional  distribution  of 
illustrative  material,  and  aids  for  using  the  book.  His 
pamphlet  is  an  improvement  over  previous  evaluating  devices 
in  that  several  pertinent  questions  are  listed  under  each 
of  the  following  topics: 

(1)  The  Author's  Background 

(2)  Content 

(3)  Validity  and  Reliability 

(4)  Style  or  Nature 

1/  John  G-uy  Fowlkes,  Evaluatinp:  School  Textbooks .  Silver, 
Burdett  and  Company,  New  York,  1923,  p.  3. 
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(5)  Organization 

(6)  Mechanical  Maka-up 

(7)  Adaptability  i/ 

Additional  space  is  provided  on  each  page  for  any 
comments  the  reviewer  wishes  to  make. 

The  following  are  a  few  of  the  questions  listed  under 
each  of  the  above  topics: 

(1)  The  Author's  Background 

1.  Is  the  book  based  mainly  on  experience?  Yes    No   

2.  Is  it  based  partly  on  experience?  Yes    No   

3«     Is  it  based  mainly  on  experimentation?  Yes    No   

4.     Is  it  based  partly  on  experimentation?  Yes    No   

(2)  Content 

1.  State  the  purpose  of  this  book  by  means  of  brief 
quotation  from  the  preface  or  introduction. 

2.  Is  relatively  too  much  space  devoted  to  any  topic 
or  topics?    Yes          No    .... 

3.  Is  relatively  too  little  space  devoted  to  an;^ 
topic  or  topics?    Yes          No    .... 

(3)  Validity  and  Reliability 

1.  Are  there  any  errors  in  fact  or  statement?  Yes   

No          If  so,  cite  page  and  line,  and,   if  possible, 

quote  authority  to  substantiate  your  charge. 

2.  Are  there  fallacies  in  the  illustrative  material?... 


(4)  Style  or  Nature 

1.  In  what  style  is  the  book  written? 

a.  Intimate?     Yes    No   

b.  Clear?  Yes    No   

c.  Coherent?     Yes    No   

d.  Concise?      Yes    No   

e.  Verbose?      Yes    No   

f.  List  any  other  strikinfZ  characteristics  of  style 
of  writing. 

2.  Would  any  part  of  the  book  appeal  to  girls  or 
women  more  than  to  boys  or  men?  Yes          No    .... 

3.  Would  any  part  of  the  book  appeal  to  boys  or  men 
more  than  to  girls  or  women?  Yes          No    .... 

4.  Is  the  book  v/ritten  in  too  detailed  a  manner? 

Yes          No          Illustrate  by  short  quotations  giving 

page  where  material  appears. 

5.  Is  the  book  written  in  a  sufficiently  comprehensive 
manner?  Yes        No  .... 


1/  Fowlkes,  op.  cit.  p.  II-3I 
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6.  Is  the  book  interesting  to  the  people  for  whom  it 
is  intended?    Yes    No   

7.  Is  the  diction  of  the  book  adapted  to  the  vocabulary 
of  the  people  for  whom  it  is  intended?  Yes    No   

8.  If  not,  is  the  diction  too  difficult?  Yes    No   

9.  If  not,  is  the  diction  too  easv?  Yes          No    .... 

10.     Is  the  book  likely  to  create  or  increase 

a.  Race  Hatred?  Yes    No   

b.  National  Hatred?  Yes          No    ■ 

c.  Sectional  Prejudice?  Yes    No   

d.  Religious  Prejudice?  Yes    No   

(5)  Organization 

1.  Is  there  any  unifying  principle?  Yes    No   

a.  If  so,  is  it  secured  by 

(1)  A  central  theme  permeating  entire  text? 
Yes    No   

(2)  Interrelation  of  chapters?  Yes    No   

2.  Does  the  organization  comply  with  psychological 
as  v/ell  as  logical  principles?  Yes    No   

3.  Is  there  provision  for  varying  types  of  teaching? 
Project  method?  Yes          No    Problem?  Yes   

No    Original  v/ork?  Yes          No           Drill  reviev*'? 

Yes          No    ■ 

4.  List  any  other  particular  types  of  teaching  for 
which  special  provision  is  made. 

(6)  Mechanical  Make-up 
A.     Binding  and  Size 

1.  Do  you  think  the  book  is  attractively  bound? 
Yes    No   

2.  Do  you  think  it  will  endure  much  use? 
Yes  No 

3. 

B. 


3.  Is 

the  book  too  heavy?  Yes   

No 

•  •  • 

Paoer 

1.'  Is 

the  paper  of  good  quality? 

Yes 

  No 

2.  Is 

it  glossy? 

Yes 

No 

3.  Is 

it  tinted? 

Yes 

No 

4.  Is 

it  too  thin? 

Yes 

No 

5.  Is 

it  too  heav-'? 

Yes 

No 

6.  Is 

it  easily  torn? 

Yes 

No 

7.  Is 

it  seemingly  durable? 

Yes 

No 

C.  Typography 
1.  Letters 

a.  Are  they  of  proper  style?  Yes    No 

b.  Are  they  of  proper  height?  Yes    No 

c.  Are  they  of  proper  thickness?  Yes    No 

d.  Are  they  properly  spaced?  Yes    No 

e.  Are  they  printed  clearly?  Yes    No 
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2. 

Words 

a.  Are  they  properly  spacel? 

Yes 

  No 

3. 

Lines 

a.  Are  they  of  proper  length? 

Yes 

  No 

4. 

t).  Are  they  properly  spaced? 

Yes 

i\'0 

Paragraphs 

a.  Are  they  properly  spaced? 

Yes 

  No 

b.  Are  the  margins  of 

sufficient  v/idth? 

Yes 

  No 

(7)  Adaptability 

A.  Do  you  think  this  hook  fulfills  the  purpose  as 
stated  in  the  preface? 

For  any  community  which  might  "be  selected  at 
random?  Yes    No   

For  some  particular  community?  Yes    No   

Briefly  give  reasons  for  your  answer. 

B.  Do  you  think  this  book  could  be  used  to  advantage? 
Yes    No   

In  what  grade  or  grades  do  you  think  it  could 
be  used  advantageously?  .... 
Briefly  give  reasons  for  your  answer. 
G.     Check  uses  for  which  you  think  this  book  could 
be  used  advantageously. 

1.  As  a  text  for  reading-  and  recitation?  ^es   

No   

2.  To  give  accurate  information?  Yes    No   

3.  To  arouse  interest  with  little  attention  to 
information?  Yes    No   

4.  To  give  a  general  knowledge  of  ? 

^es    No   

5.  To  lead  to  further  work  in   ? 

Ye  s    No   

6.  Reference  work  only?  Yes    No   

?•  As  a  laboratory  manual?  Yes    No   

8.  If  you  think  the  text  can  be  used  for  other 
purposes,  list  them. 

Miscellaneous  comments.^ 
Although  Dr.  Fowlkes'   evaluation  device  is  a  vast 
improvement  over  all  previously  constructed  score  cards,  it 
seems  to  require  more  care  and  detail  in  use  than  the  aver- 
age teacher  would  feel  free  to  give.     However  it  has  many 
good  characteristics  among  which  are  its  specific  requirements 
1/  Fowlkes,  Toe.  cit. 


while  making  provision  for  the  reviewer's  opinion. 

The  score  card  has  been  further  refined  during  this 
decade  by  assigning  a  definite  weight  to  the  items  selected 
for  evaluation.     It  v.'as  thought  that  in  this  manner  undue 
emphasis  on  relatively  insignificant  items  could  be  avoided, 
and  also  that  there  could  be  no  doubt  about  the  final  score 
if  a  few  books  were  rated  almost  equally  in  the  minds  of 
the  judges. 

An  example  of  this  type  of  score  card  is  shown  below. 
It  is  quoted  by  Oscar  F.   /tfeber  ^  from  an  article  by  Allen 
Peterson  in  the  May  1922  issue  of  School  Science  and  Mathe- 
matics on  "a  Score  Card  for  Judging  the  Value  of  G-eneral 
Science  Textbooks." 

Score  Card  for  G-eneral  Science  Texts 

Items  Weights 
I»     Interest  200 

Subject  matter  100 
Demonstration  and  experiments  60 
Supplementary  work  40 
II.     Comprehension  250 

Of  reading  matter  125 
Of  demonstrations  and  experiments  75 
Of  illustrative  material  50 
III.     Permanent  value  of  subject  matter  250 
Authorship  -  practicability  - 

permanence  100 
Scope  of  field  100 
Inculcation  of  observation  and 

independence  50 
IV.     Value  of  Method    .  200 

Arrangement  125 
Opportunities  for  application  75 

1/  Oscar  F.  Weber,  "Methods  Used  in  the  Analysis  of  Textbooks," 
School  and  Society  (November  27,  1926)   24:  678-684. 


V. 


Mechanical  element 
Type  and  print 
Pictures  and  maps 
Notes  in  indices 
Footnotes 
Margins 

Length  of  lines 

Paper 

Binding 

Size  or  shape  of  book 


Items 


Weights 
100 


40 
■  5 
5 
5 
5 
15 
15 
5 
5 


Although  this  type  of  score  card  does  rnake  it  possible 
to  obtain  a  concensus  of  many  judgments  on  numerically 
weighted  items,   it  may  be  easily  seen  that  these  values 
having  been  pre-determined  are  at  best  arbitrarily  assigned. 
The  result  being  that  a  final  impartial  analysis  is  necessary 
in  order  to  make  a  definite  decision  upon  the  textbook  to 
be  chosen. 

During  this  decade,  many  score  cards  were  prepared, 
all  similar  to  those  illustrated,  basing  their  evaluations 
mainly  on  the  following  items:     Mechanical  make-up,  author's 
background,  accuracy  of  subject  matter,  vocabulary,  teachers' 
aids,  pupil  exercises  and  illustrations.     All  score  cards 
were  prepared  because  a  need  v/as  felt  for  some  kind  of  a 
measuring  device  to  apply  v/hen  endeavoring  to  choose  one 
textbook  from  a  variety  of  books  offered. 

There  have  been  many  arguments  both  for  and  against 
the  use  of  score  cards.     These  have  been  summed  up  by  Dr. 
C.  R.  Maxwell  for  the  Thirtieth    Yearbook  of  the  Ivational 
Society  for  the  Study  of  Education. 


The  following  are  a  few  of  his  reasons  for  using  a 
score  c*ard: 

....  The  selection  of  textbooks  presents  a  tech- 
nical problem,  the  study  of  which  should  represent  a 
scientific  procedure  where  the  elements  of  chance  are 
reduced  to  a  minimum.     The  score  card  gives  an  oppor- 
tunity to  set  up  criteria  as  a  basis  for  the  analysis 
of  the  textbook.     Unless  such  criteria  are  set  up, 
the  objectives  of  the  school  system  may  be  lost  sight 
of  in  the  selection.     Score  cards  present  a  convenient 
means  for  checking  different  elements  that  must  be 
considered  if  a  textbook  is  fully  to  realize  its  pur- 
poses  Analysis  of  a  book  without  a  guide  is 

analogous  to  sailing  v/ithout  a  compass.     If  one  selects 
a  satisfactory  textbook  without  a  guide  to  assist  in 
his  analysis,  he  may  select  a  good  textbook  to  meet 
the  educational  objectives  of  his  school  system;  but 
if  he  does,  it  will  be  mere  chance.    A  score  card 
used  in  examining  books  tends  to  remove  the  personal 
element  in  Judgment.     The  more  objective  the  score 
card,  the  less  tendency  for  subjective  judgment  to 
enter  into  the  examination.    Without  a  guide  and 
without  careful  comparative  ratings,  one's  judgment 
of  the  content  of  a  book  may  be  very  faulty  =/ 

Criticisms  against  the  use  of  the  score  card  with 
explanations  by  Dr.  Maxwell  are     s  follov.s: 

The  statement  is  sometimes  made  that  we  do  not 
have  justifiable  criteria  for  the  formulation  of  a 
score  card.     This  is  an  extreme  statement  which  rep- 
resents an  attitude  of  mind  that  one  alv/ays  finds  on 
the  part  of  critics  when  attempts  are  made  to  improve 
techniques  in  any  field.     The  earlier  attempts  to 
formulate  score  cards  called  8.ttention  to  pertinent 
factors  that  should  be  considered  in  the  analysis  of 
textbooks.     The  score  cards  aided  greatly  in  over- 
coming the  tendency  to  use  such  unjustifiable  criteria 
as  have  been  mentioned  earlier  and  stimulated  further 
attack  upon  the  problem. 

Score  cards  have  also  been  criticlz.ed  on  the 
basis  that  criteria  used  represented  in  many  instances 
merely  the  judgment  of  an  individual  and  for  this 

1/  C.  R.  ivlaxwell ,  The  Use  of  Score  Cards  in  Evaluatinp; 
Textbooks ,  Thirtieth  Yearbook,  Part  II,   of  the  National 
Society  for  the  Study  of  Education,  Public  School  Publishing 
Company,  Bloomington,  Illinois,  1331,  P«  149-150. 
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reason  they  had  no  scientific  Justification.  A 
tabulation  of  the  items  used  in  tv/elve  score  cards 
indicates  that  there  is  considerable  truth  in  this 
criticism.     In  these  twelve  score  cards  160  different 
items  are  found.     Hov/ever,  in  fifty  per  cent-  of  the 
items  there  was  practically  unanimous  agreement,  shov/- 
ing  that  these  items  have  considerable  validity 
Judged  by  their  use  by  those  who  have  given  much 
thought  to  the  problem. 

In  several  score  cards  that  have  been  published, 
weighted  items  have  been  used.     The  criticism  has 
frequently  been  made  that  such  weighted  elements  have 
little  or  no  scientific  validity  because  they  have 
represented  only  individual  opinions  of  the  forraulator, 
not  opinions  secured  from  a  large  group.     But  a  large 
number  of  opinions  would  have  little  weight  —  it  is 
a  question  of  quality  rather  than  of  quantity.     It  is 
true  that  only  a  few  published  score  cards  have  been 
carefully  weighted  by  experts,  and  that  v/e  have  little 
evidence  of  their  value  based  on  wide  use. 

Score  cards  have  also  been  criticiz.ed  because 
they  have  been  formulated  by  publishers  to  insure  the 
selection  of  their  own  product.     Our  most  progressive 
publishing  companies  have  been  much  interested  in 
the  technique  for  the  formulation  of  score  cards, 
but  the  number  of  score  cards  that  have  been  circulated 
by  publishers  to  insure  the  selection  of  their  own 
books  is  comparatively  small.     Certain  publishers, 
at  least,  are  hoping  that  a  good  score  card  would 
result  in  careful  unbiased  Judgment  in  weighing  a 
textbook,  so  that  political  influence,  local  prejudice, 
and  snap  Judgment  would  no  longer  play  a  part. 
Publishers  have  undoubtedly  called  the  attention  of 
school  officials  to  the  use  that  has  been  made  of 
score  cards  and  also  to  individual  score  cards  that 
have  resulted  in  the  selection  of  a  particular  text. 
This  is  a  legitimate  procedure,  and  any  textbook 
company  is  Justified  in  calling  to  the  attention  of 
examiners  any  scientific  techniques  that  have  been 
used  in  the  selection  of  textbooks.!/ 

Sampling  techniques . —  Paralleling  the  development 

of  the  score  card  as  a  device  for  evaluating  reading 

materials  has  been  that  of  the  technique  of  sampling  the 

vocabulary  of  school  textbooks  as  a  means  of  determining 

whether  or  not  they  were  suitable  for  the  grade  in  which 

1/  Ibid.  p.  lbO-151. 
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they  were  placed. 

B.  R.  Buckingham        in  his  editorial,  "The  Textbook 

and  Its  Vocabulary,"  brings  sharply  to  our  attention  the 

fact  that  the  textbook  has  too  many  large  words  which  are 

beyond  the  understanding  of  children.     He  points  out  that 

the  "overambitious  vocabulary"  is  not  the  whole  difficulty 

but  rather  the  index  to  it. 

It  is  entirely  true  that  the  vocabulary  of  a 
textbook  should  contain  a  certain  rather  large  number 
of  new  words.     No  doubt  many  of  these  should  be  of 
a  technical  character  -  technical,  that  is,  to  the 
subject  in  question....   It  should  be  just  as  much  a 
part  of  the  author's  business  to  know  the  technical, 
semi-technical,  and  literary  words,.,,  as  it  is  for 
him  to  knov;  the  facts  of  his  subject  matter.  When 
these  words  are  known  it  then  becomes  possible  to 
provide  for  their  gradual  introduction,  their  frequent 
initial  repetition,  and  their  recurrence  in  later 
pages  of  the  text.     It  is  impossible  to  estimate  how 
great  an  advance  in  the  mastery  of  a  subject  might 
arise  from  a  skillful  -  that  is  from  a  truly  psycho- 
logical blending  and  repeating  of  verbal  matter  

He  proceeds  to  suggest  that  there  should  be  both  a 
subject  matter  specialist  and  an  educational  specialist 
on  the  authorial  staff  of  every  school  text:     the  first  to 
furnish  the  logical,   scientific,   scholarly  point  of  view; 
the  second  to  interpret  it  and  rewrite  it  in  a  vocabulary 
understandable  to  and  suitable  for  the  child  for  v/hose 
grade  it  is  intended. 

One  of  the  first  studies  of  vocabulary  difficulty 

using  the  sampling  technique  was  undertaken  by  Bertha  A. 

1/  B.  R.  Buckingham,  "The  Textbook  and  Its  Vocabulary," 
Journal  of  Educational  Research,   (September  1926)  14: 
p.  142-1^5. 


Lively  and  S.  L.  .Pressey.i^    Their  study  was  the  result  of 
a  minor  investigation  regarding  the  number  of  technical 
v;ords  in  a  certain  junior  hi -en  school  science  book. 

The  method  finally  adopted  consisted  of  obtaining 
a  sampling  of  one  thousand  words  throughout  the  text. 
They  obtained  the  saaiple  by  taking  one  line  per  page  from 
enough  pages  evenly  distributed  throughout  the  book  to 
make  the  thousand  words.     Once  the  v/ord  count  was  procured, 
the  total  number  of  different  v/ords  in  the  thousand  was 
first  noted.     This  was  called  "vocabulary  rar-ge . "     The  next 
step  was  to  look  these  words  up  in  the  Thorndike  "Vn'ord 
Eook"^  and  find  and  assign  the  index  number  for  each. 
Those  words  which  did  not  appear  in  the  Thorndike  list  were 
given  an  index  number  of  zero.     These  words  v/ith  the  zero 
valuation  were  taken  to  indicate  the  size  of  the  technical 
vocabulary.     The  weighted  median  index  number  was  finally 
calculated,  which  is  simply  the  median  index  number  with 
the  zero  value  v/ords  counted  twice.     Result,  the  higher 
the  median  index  number  the  easier  the  vocabulary.  Sixteen 
different  types  of  reading  material  were  examined  in  this 
manner  and  from  each  two  samplings  of  one  thousand  words 
were  taken  in  order  to  determine  the  reliability  of  the 

method.     In  the  authors'  opinion  "the  method  seems  fairly 

1/  Bertha  A.  Lively  and  S.  L.  Pressey,   "A  Method  for 
Measuring  the  Vocabulary  Burden  of  Textbooks,"  Educational 
Administration  and  Supervision.   (October  1923)  9:  p.  5c39-398. 

2/  E.  L.  Thorndike,  The  Teachers '   .Vord  Book.  Teachers' 
College,  Bureau  of  Publications,  Columbia  University, 
New  York  City,  New  York,  1921,  13^  p. 


reliable."    From  this  study  three  findings  were  obtained, 
"(a)  range  of  vocabulary,  (b)   size  of  highly  technical 
vocabulary  (zero  value  words)  and  (c)  the  v/eighted  median 
index,  number." 

Another  study  using  the  sampling  technique  was  made 
by  F.  D.  Keboch,       Superintendent  of  Schools,  Aspinwall, 
Pennsylvania.     He  made  his  study  on  the  variability  of 
word  difficulty  as  a  result  of  many  complaints  from  his 
teachers  of  American  history  in  the  seventh  grade  that, 
"the  pupils  have  difficulty  in  reading  and  understanding 
certain  textbooks  in  the  subject."     He  chose  five  textbooks 
used  in  the  schools  under  his  jurisdiction  and  subjected 
them  to  a  word  count.     He  took  every  fifth  page  until  he 
had  a  total  of  forty-five  full  pages  from  each  book.  In 
this  sampling  he  tabulated  all  the  words  and  their  frequen- 
cies and  then  compared  them  with  the  lists  given  in  the 
Thorndike  Viford  Book,  classifying  each  word  according  to  the 
designations  given  in  the  Thorndike  list.     He  then  eliminated 
all  words  found  within  the  first  five  thousand  words  in 
the  Thorndike  list  because,  "Dr.  Thorndike  when  interviewed 
'was  of  the  opinion  that  the  words  within  this  group  were 
entirely  familiar  to  seventh  grade  pupils  1"  From  the  words 
not  eliminated  he  computed  the  arithmetical  mean,  the 
standard  deviation,  and  the  coefficient  of  dispersion  which 
is  the  standard  deviation  divided  by  the  mean.     Those  books 

1/  F.  D.  Keboch,  "Variability  of  »Vord  Difficulty  in  Five 
American  History  Texts,"  Journal  of  Educational  Research, 
(January  1927)  15:  p.  22-^.  
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with  the  highest  standard  deviation  and  the  highest  coefficient 
of  dispersion  he  decided  were  the  most  difficult.     As  to 
those  words  not  found  in  the  Thorndike  list,  Mr.  Kehoch 
submitted  thera  to  six  competent  judges  with  directions  to 
mark  each  G  if  it  seemed  to  he  of  general  usefulness,  H  if  it 
were  useful  in  history  in  the  seventh  grade  and  v/ith  an 
interrogation  mark  if  it  was  of  "doubtful  service  in  the 
seventh  grade."     He  then  computed  an  index  of  uselessness 
of  the  vocabulary  of  each  book  tested,  by  dividing  the  total 
number  of  times  the  interrogation  mark  was  found  in  the 
result  of  rating  by  all  judges  by  the  total  number  of  v/ords 
not  found  in  Thorndike 's  .Vord  Book. 

H.  H.  Remmers  and  A.  G-rant  — engaged  in  an  investigation 
of  vocabulary  difficulties  with  the  following  two-fold 
purpose  in  mind:  "(1)  to  measure  the  vocabulary  burden  of 
secondary  mathematics  textbooks,  and  (2)  to  determine  the 
reliability  of  measurement  in  the  methods  employed." 

Their  method  began  very  similarly  to  the  earlier  Lively 

and  Pressey  ^  study.     They  obtained  a  thousand  word 

sampling  by  securing  words  from  a  deslc-nated  line  of  a 

number  of  pac^es  evenly  distributed  throughout  the  book. 

All  of  the  different  words  were  then  listed  alphabetically 

and  their  frequencies  noted,  which  gave  the  vocabulary 

1/H.  H.  Remmers  and  A.  G-rant,  "The  Vocabulary  Load  of 
Certain  Secondary  School  Ivlathematics  Textbooks,"  Journal 
of  Educational  Research,   (October  1928)  18:  p..  203-210. 

2/  Lively  and  Pressey,  op.  cit. 

range.     These  words  were  then  looked  up  in  the  Thorndike 
Word  List  and  given  the  index  number  designated  there.  All 
the  v/ords  which  did  not  appear  in  the  Thorndike  list  were 
then  listed  and  assigned  a  value  of  zero.     These  were 
considered  as  the  highly  technical  part  of  the  vocabulary. 
They  then  computed  the  median  index  number  which  is  merely 
a  numerical  index  of  the  book's  vocabulary  difficulty. 
"Evidently  the  lower  the  index  number  the  more  difficult  the 
book."^  So  far  tnia  method  has  differed  from  the  Lively 
and  Pressey  method  solely  in  that  the  words  with  a  zero 
valuation  were  only  counted  once. 

A  second  sampling  was  made  from  each  book  using  differ- 
ent pages  as  a  means  of  comparing  the  two  counts.  They 
also  computed  the  probable  error  of  the  counts  both  for  the 
vocabulary  range  and  the  zero  words.     This  was  done  by 

using  the  formula:     P.  E.  =  .67^5    /  P^        in  which  N  is 

J  N 

the  number  of  words  (1000)  P  is  the  number  of  different 
words  and  ^  the  number  of  different  words  subtracted  from 
the  number  of  v/ords.     This  resulted  in  tne  following  hypoth- 
esis:    "One  book  was  considered  to  have  a  more  difficult 
vocabulary  than  the  other  if  the  ratio  of  the  difference  in 
the  number  of  zero  words  to  their  P.  E.  difference  was  more 
than  3.0."^ 

1/  Remmers  and  G-rant ,  loc.  cit. 

2/  Francis  D,  Curtis,  Investigations  of  Vocabulary  in 
Textbooks  of  Science  for  Secondary  "ocHoois ,  G-lnn~anT"Company 
Boston,  Massachusetts,  1938,  P-  W» 


In  1926  Carleton  Washburne  and  Mabel  Vogel  decided  • 
that  an  objective  method  for  determining  the  suitability 
of  reading  materials  used  by  children  in  the  classrooms 
was  needed  by  all  teachers.     They  therefore  laid  the 
foundation  for  such  a  study  by  providing  ballots  to  thirty- 
six  thousand  seven  hundred  fifty  v/idely  scattered  children, 
who  reported  on  all  the  books  which  they  had  read  during 
the  previous  year.     The  results  of  these  ballots  when 
tabulated  made  up  the  <vinnetka  G-raded  Book  List «— 

From  this  book  list  one  hundred  fifty-two  books  were 

2/ 

chosen  for  the  present  study.— A  group  of  twenty  volunteer 
teachers  examined  these  books  for  "every  conceivable  element 
of  difficulty  which  might  influence  grade  placement." 
The  following  are  the  elements  upon  v/hich  the  examination 
was  based: 

1.  Vocabulary  difficulty  (according  to  the  Lively  and 
Pressey  technique).!/ 

a.  Number  of  different  words  occurring  in  a  sampling 
of  one  thousand  words. 

b.  Median  index  number /(based  on  Thorndike's 
indexed  woru  list)-t/  of  a  thousand  v/ord  sampling, 

c.  Number  of  words  in  a  thousand  word  sampling  not 
occurring  in  Thorndike's  list. 

1/  Mabel  Vogel  and  Carleton  aashburne,   <Vinnetka  G-raded  Book 
List,  American  Library  Association,  Chicago,  Illinois,  1926. 

2/  Mabel  Vogel  and  Carleton  Washburne,   "An  Objective  Method 
of  Determining  the  G-rade  Placement  of  Children's  Reading 
Material,"  Elementary  School  Journal .   (January  1928)  28: 
p.  373-381. 

3/  Bertha  A.  Lively  and  3.  L.  Pressey  op.  cit. 
4/  E.  L.  Thorndike  op.  cit. 


2,  Sentence  structure  of  seventy-five  sample  sentences, 

a.  Sentence  use  -  declarative,  exclamatory,  im- 
perative and  interrogative. 

b.  Sentence  form  -  simple,   complex,  compound  and 
complex- compound. 

c.  Dependent  clauses  -  noun,  adjective,  and 
adverbial . 

d.  Phrases  -  adjective,  adverbial,  infinitive,  and 
parti  cipial . 


3.  Parts  of  speech  occurring;  in  a  sampling  of  one 

thousand  v/ords  -  nouns  (common  and  proper,  abstract 
and  concrete),  pronouns,  verbs  (action  and  non- 
action, transitive  and  intransitive),  infinitives, 
participles,  gerunds,  adjectives  (sensory  and  non- 
sensory),  articles,  adverbs,  prepositions, 
conjunctions,  interjections  and  expletives. 

Paragraph  construction 

a.  Number  of  sentences  and  words  per  paragraph 
of  conversation  and  non  conversation. 

b.  Percentage  of  seventy-five  sentences  containing 
conversation. 


5.  '3-eneral  structure 

a.  Number  of  words  to 
a  book,  and  number 

b.  Length  of  chapters 


r-x  line,  number  of  lines  to 
of  words  to  a  book. 


6.  Physical  make-up 

a.  eight 

b.  Size  of  type 

c.  Length  of  line 

d.  Distance  betv/een  lines 


After  all  the  elements  were  tabulated  and  countel 
for  each  book,  each  element  was  graphed  to  determine  whether 
there  was  a  definite  rise  or  fall  from  grade  to  grade. 
Those  elements  showing:;  the  most  definite  rise  or  fall  from 
grade  to  grade  were  chosen  for  further  study  and  the  others 
were  cast  aside. 

Ten  elements  were  chosen  which  correlated  as  little 
as  possible  with  one  another  but  as  highly  as  possible 


with  the  median  reading  score  of  the  children  who  read  and 
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enjoyed  the  "books  measured. 

Various  combinations  of  the  ten  elements  were 
tried  and  a  series  of  multiple  correlations  found. 
The  best  multiple  correlation  (.845),   combining  four 
elements,  was  made  the  basis  of  a  regression  equation 
which  predicts  with  a  high  degree  of  reliability  the 
reading  score  necessary  for  the  reading  and  under- 
standing of  any  given  book.  .... 

The  elements  which  have  a  multiple  correlation 
of  .845  are  as  follov7s:     number  of  different  words 
occurring  in  a  sampling  of  one  thousand  words,  (Xg), 
number  of  prepositions  (   including  duplicates)  occurring 
in  a  one  thousand  word  sampling  (X^),  number  of  words 
(including  duplicates)  in  a  one  thousand  word  sampling 
not  occurring  in  Thorndike's  list  (X^^.),  and  the  number 
of  simple  sentences  in  seventy-five  sample  sentences  (X^). 

The  following  technique  was  derived  from  the  study, 

which  may  be  used  by  any  teacher  who  wishes  to  discover  the 

grade  placement  of  her  reading  materials. 

1.     Make  a  sampling  of  one  thousand  words  from  the 
book  as  follows: 

a.  Determine  the  number  of  pages  in  the  book. 

b.  Determine  the  number  of  words  per  line  by 
counting  the  number  of  words  in  ten  lines 
scattered  through  the  book  and  dividing  by  ten. 

c.  Divide  one  thousand  (the  number  of  v/ords 
needed)  by  the  number  of  words  per  line  .... 
obtaining  the  number  of  pages  from  which 
sample  lines  are  to  be  chosen. 

d.  Divide  the  number  of  pages  in  the  book  by 

the  number  of  pages  from  which  the  sample  lines 
are  to  be  chosen.     The  quotient  gives  the  pages 
from  which  the  sample  lines  will  be  taken. 
If  for  example  the  quotient  was  3«2  the  sample 
lines  v/ould  be  taken  from  every  third  page. 

e.  Copy  on  a  separate  card  "every  word  from  the 
top  line  (or  any  given  line)  of  every  page 

to  be  sampled.  Put  a  p  in  the  corner  of  each 
card  containing  a  word  used  as  a  preposition. 

f.  After  copying  the  words  from  a  given  line  on 
the  number  of  pages  estimated  in  c,   count  the 
cards.     If  there  is  not  an  even  thousand 
discard  any  excess,  or  add  cards  by  copying 
words  from  additional  lines  until  an  exact 
thousand  is  reached. 
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g.  Arrange  cards  in  strictly  alphabetical  order 
so  that  all  duplicates  of  any  given  word  come 
together.     Eliminate  all  duplicate  cards, 
writing  the  total  number  of  such  cards  on  the 
one  card  that  remains..,. 

2.  Count  the  cards  after  the  duplicates  have  been 
eliminated,  thus  obtaining  the  number  of  different 
words  in  a  thousand.     Call  this  number  Xg* 

3.  Count  the  total  number  of  prepositions  in  the 
thousand  words.     If  the  preposition  "in"  for 
example  occurs  fifteen. times ,  it  should  count  as 
fifteen  prepositions.     Record  the  total  number 
of  prepositions  as  X^. 

4.  Check  each  v;ord  card  with  Thorndike '  s  word  list. 
Count  the  total  number  of  words  including  dupli- 
cates, which  do  not  occur  in  Thorndike 's  list.... 
Record  the  total  number  of  words  not  included  in 
Thorndike 's  list  as  X4. 

5.  Make  a  sampling  of  seventy-five  sentences  from 
the  book  as  follows: 

a.  Count  the  total  number  of  pages  in  the  book, 
excluding  picture  pages. 

b.  Divide  the  number  of  pages  in  the  book  by  75 
to  determine  which  pages  must  be  chosen.... 

c«  Tabulate  as  simple  or  not  simple  the  first 

complete  sentence  on  every  page  to  be  sampled. 
A  simple  sentence  is  defined  as  one  in  which 
there  are  no  dependent  or  co-ordinate  clauses; 
it  therefore  contains  only  one  subject  and  one 
predicate, 

6.  Count  the  number  of  simple  sentences  in  the  seventy- 
five  sentences  sampled.     Record  this  number  as  X^. 

7»    Apply  the  following  regression  equation  to  the 

data,  Xi  being  the  reading  score;  X2  the  number  of 
different  words  in  one  thousand;  X-^  the  number  of 
prepositions  in  one  thousand  words;  X4  the  number 
of  uncommon  words  in  one  thousand,  and  X^  the 
number  of  simple  sentences  in  seventy-five: 

Xi  =  .085X2  i-  .101X3  i-  .604X4  -  .411X5  i  17.43 

The  answer  to  the  equation  will  be  the  score  on  the 
paragraph  meaning  section  of  the  Stanford  Achievement  Test 
necessary  for  reading  the  book  measured. 
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By  observing  the  grade-score  table  on  the  Stanford 

Achievement  Test  the  ansvv'er  may  be  further  translated  into 

reading  grade. 

A  unique  technique  is  that  reported  by  Lewerenz. 
He  compared  the  number  of  different  words  which  began 
with  each  letter  of  the  alphabet  in  a  given  sample 
selection  with  the  number  which  appeared  under  the 
same  letter  in  Webster's  Slementar.y  School  Dictionary* 
The  results  of  his  study  led  him  to  select  the  five 
letters  Vil,  H,  B,  I  and  E  as  "critical  letters"  that 
is,  those  which  indicate  the  reading  difficulty  of 
the  sample  and  hence  of  the  book.     He  based  this 
selection  on  his  discovery  that  in  easy  material 
words  beginning  with  Vn',  H  and  B  were  numerous,  while 
words  beginning  with  I  and  E  v/ere  comparatively  rare; 
and  that  in  difficult  material  these  conditions  were 
reversed. 

In  these  studies  of  sampling  techniques  many  rather 
ingenious  formulae  have  been  developed  for  determining  the 
vocabulary  difficulty  of  a  textbook  and  thereby  its  grade 
placement. 

It  has  been  said  hov/ever  that  a  sampling  technique 
can  never  be  as  accurate  as  a  complete  v/ord  count  and  is 
employed  only  on  the  grounds  of  being  practicable  and 
expedient.     Despite  this  fact  though  this  method  has  been 
severely  criticized  by  Mr.  E.  liV.  Dolch  in  the  following 
statement: 

Textbooks  are  not  and  cannot  be  homogeneous.... 
no  section  of  the  book  can  fairly  represent  all  sec- 
tions.    To  overcome  this  difficulty  the  method  of 

1/  Alfred  3.  Lewerenz,   "Measurement  of  the  Difficulty  of 
Reading  Materials,"  Educational  Research  Bulletin,  Los  Angeles 
City  Schools,   (March  1929)  8:  p.  11-16  as  quoted  from 
Francis  Curtis  op.   cit.  p.  12. 

2/  E.  W.  Dolch,   "Vocabulary  Burden,"  Journal  of  Educational 
Research,  (March  1928)  17:  p.  170-183. 


sampling  selects  lines  at  regular  intervals  throughout. 
This  runs  into  even  greater  inaccuracy.     The  sample 
is  then  not  a  piece  of  reading  matter,  but  a  succession 
of  disconnected  bits.     It  fails  to  represent  the  text 
because  it  cannot  possibly  show  the  factor  of  repetition 
of  words.     No  matter  how  careful  an  author  was  to  repeat 
his  statements,  it  would  make  no  difference  in  such  a 
sampling,  because  a  single  line  on  a  page  does  not  show 
what  precedes  or  follows  it,  and  another  line,  five 
pages  on,  or  even  on  the  next  page  will  almost  certainly 
contain  different  material.     Occasional  whole  pages 
might  form  a  better  sample,  but  still  not  a  represent- 
ative one  for  the  same  reason.     In  fact,  the  conditions 
of  language  and  style  in  writing  are  such  that  no  study 
of  pieces  can  truly  represent  the  v;hole. 

Complete  word  count  techniques . In  view  of  these 

facts  expressed  so  tersely  by  Dolch,  some  studies  have  been 

made  in  which  complete  or  practically  complete  word  counts 

were  used. 

Orlando  VV.  Steohenson        faced  with  the  oroblem  of 
enlarging  the  vocabulary  of  the  pupils  in  his  social  studies 
class  to  enable  them  to  better  understand  and  appreciate 
newspaper  and  magazine  material,  employed  the  help  of 
several  high  school  teachers  and  more  than  forty  seniors 
and  graduate  students  of  the  University  of  Michigan.  These 
investigators  examined  the  indexes  of  ten  textbooks  in 
the  socialized  studies  (history,  geography  and  civics)  for 
secondary-schools,  and  listed  all  the  words  and  expressions 
with  which  in  their  opinions  the  pupils  should  become  familiar. 
After  completing  the  first  list  four  more  persons  searched 
the  texts  for  additional  words  or  expressions  which  may 

have  been  previously  overlooked.     To  this  second  list  were 

1/  Orlando  W.  Stephenson,  "The  Special  Vocabulary  of  Civics," 
Journal  of  Educational  Research,   (November  1928)  18:  p.  297-304. 


added  several  words  which  twelve  experienced  teachers  in 
civics  had  found  frequent  occasion  to  use  in  their  own 
classes.     The  final  or  master  list  was  taken  by  tv/enty 
investigators  each  of  whoia  read  one-half  of  one  of  the  ten 
selected  textbooks  and  tabulated  the  number  of  times  each 
word  or  expression  appeared  in  all  of  the  texts  together. 

To  check  the  accuracy  of  the  count  and  to  determine  the 
probable  error,  twenty  words  were  selected  at  random  from  the 
master  list  and  the  appearance  of  each  was  carefully  counted 
in  all  the  books.     The  results  of  this  recount  indicated  the 
original  counts  to  be  approximately  fourteen  per  cent  too  lov/; 
therefore  to  rectify  this  error  fourteen  per  cent  was  added 
to  the  total  frequency  of  each  word  on  the  master  list. 

C  •  G- .  Shambaugh        made  a  complete  word  count  of  five 
widely  used  history  textbooks,   (1)   to  measure  the  vocabulary 
difficulty  in  high  school  textbooks  and  (2)  to  discover  to 
v/hat  extent  the  content  is  suited  to  the  needs  and  capacities 
of  the  ninth  grade  student. 

He  arranged  his  entire  list  of  words  found,   in  alphabet- 
ical order  and  tabulated  their  frequencies  both  to  show  the 
number  of  times  a  word  appeared  in  one  text  as  v;ell  as  its 
total  frequency  in  all  five  texts.     He  compared  his  results 

both  v/ith  the  Ayres        list  of  one  thousand  familiar  v;ords 

1/  G.  Shambaugh,  "A  Study  of  the  Vocabulary  of  Ancient 
History  Texts,"  School  and  Society  (October  20,  1928)  28: 
p.  494-496. 

2/  Leonard  P.  Ayres,  A  Measuring  Scale  for  Ability  in  Spelling. 
The  Russell  Sage  Foundation,  Division  of  Education,  New  York, 
1915. 


and  with  the  Thorndike 

y  list  of  ten  thousand  words.  Then 
he  computed  the  percentage  of  frequency     (1)  of  all  the  words 
which  appeared  in  each  text  and  also  in  the  Ayres  list;  (2) 
of  all  the  words  found  in  each  text  which  were  also  in  the 
Thorndike  list  but  not  in  the  Ayres  list;   (3)  of  all  the  words 
not  found  in  the  Thorndike  list  and  (4)  of  the  total  numher  of 
different  words  not  found  in  the  Thorndike  list. 

He  concluded  that  the  vocabulary  in  ancient-history 
texts  offers  a  great  deal  of  difficulty  to  the  ninth-grade 
student  as  more  than  half  of  the  uncommon  words  do  not  appear 
in  any  one  text  more  than  once,  therefore  giving  the  student 
no  opportunity  to  become  familiar  with  them. 

He  also  decided  from  his  careful  reading  of  the  material 
that  the  content  of  some  of  the  texts  had  little  connection 
with  the  life  or  interests  of  the  average  ninth-grade  student. 

The  selection  of  textbooks. —  Before  concluding  this 
first  decade  it  might  be  well  to  state  the  current  practices 
observed  in  the  United  States  for  the  selection  of  textbooks. 
These  have  been  summarized  by  Frank  A.  Jensen  in  the  Thirtieth 
Yearbook  of  'the  National  Society  for  the  Study  of  Education. 

2/ 

1.  Practice  in  cities  of  a  population  between  25,000 
and  250,000  Indics.tes  that  the  city  usually  operates 
as  a  unit  in  the  selection  of  instructional  material 
and  has  full  power  to  select  its  own  textbooks. 

2.  The  authority  for  selecting  textbooks  rests  legally 
upon  the  city  board  of  education. 

1/  E.  L.  Thorndike  op.  cit. 

2/  Frank  A.  Jensen,  Current  Practices  in  Selecting  Textbooks 
for  the  Elementary  Schools .  Thirtieth  Yearbook  of  the  National 
Society  for  the  Study  of  Education,  op.   cit.  p.  141-142. 


3.  The  board  of  education  almost  invariably  delegates 
this  authority  to  the  superintendent  of  schools, 
but  holds  his  recommendation  subject  to  its 
(commonly  perfunctory  )  approval. 

4.  The  superintendent  of  schools  calls  upon  his 
assistants,  the  actual  users  of  textbooks,  to 
advise  him  on  the  problem  of  selecting;  textbooks. 

5.  The  advisers  to  the  superintendent  of  schools  are 
usually  orfsanized  as  a  committee. 

6.  The  superintendent  of  schools,  who  is  responsible 
for  the  selection  of  textbooks  and  makes  recom- 
mendations to  the  board  of  education,  appoints 
the  members  of  the  textbook  committee. 


7.  A  distribution  of  membership  in  a  textbook  committee 
in  keeping  with  practice  in  city  schools  and  the 
opinion  of  city  superintendents  would  comprise 
about  50  per  cent  teachers,  25  per  cent  principals, 
15  per  cent  supervisors,  and  10  per  cent  superin- 
tendent's staff.     The  board  of  education  is  rarely 
repre  sented. 

8.  Large  textbook  coifmiittees  are  not  practical;  the 
effective  committee  has  from  three  to  seven  members. 

9.  The  efficient  textbook  committee  is  an  open  com- 
mittee -  open  both  to  school  people  and  to  pub- 
lishers' representatives. 


10.  Textbook  committees  are  in  most  cases  temporary; 
they  cease  to  exist  after  they  have  solved  tneir 
problems  and  made  their  reports  


11.  The  reports  of  the  textbook  committee  are  regarded 
as  being  only  recommendations  to  the  superintendent 
of  schools,  but  the  recommendations  are  usually 
followed. 

12.  The  superintendent  of  schools,   in  appointing  the 
committee,  generally  states  its  problem.  The 
committee,  however,  sets  up  its  own  standards  of 
evaluation  for  the  instructional  material  considered. 
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Improved  criteria  for  selecting  reading  materials. - 
Whereas  the  first  section  of  this  chapter  dealt  with  the 


origin  and  development  of  methods  of  evaluating  reading 
materials  so  this  section  will  show  how  they  have  been 
improved  and  refined. 

Very  similar  to  Dr.  Maxwell's  ^  six  "broad  underlying 
principles"  are  the  following  ten  points  v^hich  Dr.  G-uy  M» 
Jifhipple        in  1930  suggested  that  all  textbook  committees 
observe  when  selecting  new  reading  materials: 

1.  Suitable  content  -  The  committee  should  have  in  mind 
the  objectives  to  be  attained  in  the  teaching  of  the  subject 
and  then  ask  themselves  if  the  book  will  accomplish  these 
and  be  a  superior  book  as  vjell. 

2.  Suitable  presentation  -  Besides  checking  the  vocab- 
ulary the  committee  should  note  whether  provision  is  made 
for  introducing  new  words  and  they  should  also  take  into 
consideration  that  the  "style  of  the  sentence  is  just  as 
important  as  the  words  in  it." 

3.  Suitable  teaching  aids  -  The  inclusion  of  maps, 
charts,  illustrations,  reviews,   questions,  and  other  aids 
are  valuable,  but  they  should  be  examined  carefully  to  be 
certain  that  they  are  pertinent. 

4.  Reputation  of  author  -  The  committee  should  always 
endeavor  to  find  out  who  wrote  the  textbook.     Many  books  are 
practically  rewritten  in  the  editorial  room  of  the  publish- 
ing house.     Again  authors  grov/  old  and  their  places  must  be 
1/  C.  R.  Maxwell,  op.   cit.  p.  48 

2/  G-uy  M.  Whipple,  "The  Selection  of  Textbooks,"  American* 
School  Board  Journal  (May  1930)  80:  p.  51-53. 


taken  "by  younger  writers.     It  is  unfortunate  that  many  new 
and  good  books  are  often  cast  aside  because  no  member  of 
the  committee  has  heard  of  the  author. 

5.  Reputation  of  publisher  -  "This  is  often  a  better 
guarantee  of  the  value  of  a  book  than  the  reputation • of  the 
author." 

6.  Suitable  format  -  The  selection  committee  should 
satisfy  itself  that  the  binding,  type,  paper  and  other 
factors  of  format  are  durable  and  legible  but  otherwise 
should  not  concern  itself  too  much  with  this  item. 

7.  Local  prejudice  -  This  point  might  refer  to  any 
sectional  feeling  which  the  context  of  the  textbook  might 
stir  up.     For  example,  the  attitude  of  some  southern  towns 

"toward  a  history  book  which  favored  the  North  in  its  treat- 
ment of  the  Civil  War.     Each  textbook  committee  would  have  to 
handle  this  item  according  to  its  ov/n  local  situation. 

8.  Up-to-dateness  on  fads  -  For  example,  the  question 
"is  the  book  planned  along  the  Unit  Idea?"  may  merely  mean, 
"Has  the  heading,   chapter,  been  changed  to  unit?"  The 
committee  should  be  satisfied  if  the  book  correlates  with  real 
life  situations  and  meets  the  felt  needs  of  the  community. 

9»  The  copyright  date  -  Selection  committees  should  be 
influenced  by  a  nev/  copyright  date  only  when  the  book  deals 
with  subject  matter  in  which  important  advances  have  been 
recently  made. 

10.  Usefulness  of  score  cards  -  A  score  card  may  help  to 


keep  certain  points  before  the  committee,  and  also  it  enables 
them  to  record  and  compare  their  judgments.    While  on  the 
other  hand  a  score  card  may  give  an  appearance  of  exactitude 
when  it  is  not  present  nor  wanted. 

Similar  to  these  also  are  the  "18  Criteria  for  Choosing 
New  Textbooks"  proposed  by  Leland  B.  Jacobs  i/  in  1937* 

1.  Authorship 

1.  Yifhat  training  and  experience  has  the  author  had 
that  qualify  him  to  write  this  particular  book? 

2.  Does  the  author's  point  of  view  best  serve  the 
present  needs? 

2.  Curriculum  Needs 

Conformity  with  both  the  trends  of  progressive 
educational  theory  and  the  philosophy  of  the  local 
school  system  is  important  in  choosing  new  teaching 
materials . 

1.  What  purposes  or  objectives  are  recognized  in 
this  book? 

2.  Is  the  relationship  between  avowed  objectives 
and  the  choice  and  arrangement  of  subject  matter 

•  consistently  and  definitely  established  and 
maintained? 

3.  Is  the  material  organized  in  keeping  v/ith  present 
progressive  concepts  of  learning? 

4.  Does  the  material  included  give  adequate  consid- 
eration to  fundamental  social  aspects  of  the 
educative  process? 

3.  Adaptation  to  Children's  Use 

1.  Is  the  material  so  v/ritten  that  it  meets  the 
needs  and  interests  of  children  in  an  engaging 
and  appealing  manner? 

2.  Is  the  material  well  adapted  to  provide  for 
individual  differences  among  children  and  classes? 

3.  Does  the  arrangement  of  the  various  units 
promote  consistent  end  integrated  thought 
development,   study  habits,   and  grov;th  in  power 
to  solve  problems  among  children? 

4.  Adaptation  to  Teachers'  Use 

1.  Is  the  material  arranp-ed  in  convenient  units 
for  teaching? 

1/  Leland  B.  Jacobs,  "13  Criteria  for  Choosin--  /v  Textbooks," 
Clearing,  House  (April  1937)  H :  p.  435-486. 
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2.  Is  the  subject  matter  presented  in  a  sequence 
that  is  psychologically  sound? 

3.  Do  all  the  suggested  related  activities,  study 
helps,  and  suggested  readings  possess  a  high 
degree  of  utility? 

4.  Can  this  material  be  efficiently  adapted  to 
individual  and  community  interests  and  needs? 

5.  Format 

1.  Is  the  general  appearance  of  the  book  artistic 
and  appealing  to  children? 

2.  Is  the  book  a  convenient  size? 

3.  Is  the  durability  of  the  book  insured  by  high 
.  quality  materials  and  workmanship? 

4.  Are  the  illustrative  materials  in  the  book 
attractive,  artistic,  authentic,  and  in  sensible 
proportion  with  the  other  content  of  the  book? 

5.  Are  the  hygienic  standards,-  finish  of  paper, 
size  of  print,  margins  and  page  arrangement 
consistently  high? 

Score  cards  also  flourished  during  this  period.  Many 

excellent  ones  were  prepared  in  the  following  subjects: 

comuosition.       science, 2/  geography, 5/  reading, ii/  and  history. 

1 

Mr.  J.  R.  McKillop        constructed  a  textbook  scale 

1/  M.  E.  Marye,  "Form  For  Rating  Textbooks  in  English 
Composition  Prepared  for  the  Ninth  and  Tenth  G-rades," 
School  Review  (February  1930)  38:  p.  124-137. 

2/  VJ.  J.  Bray,  "Selection  of  High  School  Science  Textbooks," 
Science  Education  (October  1934T  18:  p.  147-151. 

3/  'KVilliam  M.  Gregory,  "Scoring  Plan  for  Elementary 
Geography  Texts,"  Education  (January  1935)   55 t  p.  307-313* 

4/  Ivan  R.   Waterman  and  Irving  R.  Melbo,  "A  Plan  of 
Procedure  for  the  Evaluation  of  Textbooks  in  Reading," 
Elementary  School  Journal  (May  1935)  35:   p.  662-674. 

^  Francis  R.  Kniss,   "Selecting  a  Textbook  in  Tenth  Grade 
'World  History,"  Educational  Administration  and  Supervision 
(September  1935)  21:  p.  465-WoT 

6/  J.  R.  McKillop,  "Objective  Judgment  and  Comparison  of 
Textbooks,"  American  School  Board  Journal  (May  1933)  86: 
p.  54. 


called  "Book  Revievv*  Form"  which  could  he  used  in  judging 
any  type  of  text.     He  patterned  it  after  an  earlier  one 
produced  by  John  G-uy  Fowlkes.i-^  The  main  advancement  of  this 
scale  over  the  earlier  one  is  in  the  assigning  of  v/eights 
to  the  various  elements,   thereby  reducing  much  of  its  sub- 
jectivity. 

However  the  form  v/hich  shall  be  reproduced  here  as 
typical  of  this  period  is  one  prepared  for  the  evaluation 
of  composition  textbooks  by  the  National  Council  of  English 
Teachers  under  the  chairmanship  of  Dora  V.  Smith. 

This  device  was  oricfinally  intended  to  be  merely  a 
series  of  statements,  the  most  important  ones  starred. 
Then  some  teachers  requested  that  it  be  given  a  slight 
numerical  value,  because  in  that  way  it  would  be  of  greater 
value  to  them.     The  following  procedure  was  adopted: 

1.  Place  a  3  on  the  line  in  front  of  each  item  to 
which  you  can  8.nswer  an  unqualified  "yes"  for  the 
textbook  under  consideration. 

2.  Place  a  0  before  each  question  to  which  you  must 
answer  an  unqualified  "no." 

3.  If  your  answer  is  qualified  but  nearer  "no"  than 
"yes"  put  a  1  in  front  of  the  item. 

4.  If  your  answer  is  qualified  but  nearer  "yes"  than 
"no    put  a  2  in  front  of  the  question. 

5.  Total  your  points  within  each  of  the  sections 
indicated  by  the  Roman  numerals.     These  figures 

1/  John  G-uy  Fowlkes,  op.  cit. 

2/  Dora  V.  Smith,  "Evaluation  of  Composition  Textbooks," 
Report  of  the  National  Council  of  English  Teachers  Committee, 
English  Journal  (High  School  Edition  and  College  Edition) 
(April  1932)   21:  p.  280-294. 
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may  then  "be  compared  v/ith  the  ratings  of  other 
textbooks  for  the  same  section. 

Check-list  of  Questions  for  Consideration 

in  the  Selection  of  a  Textbook  in  Composition 

Total 

I.     The  Viewpoint  of  the  Textbook 

■»^A.  Does  the  author  recognize  that  composition 

is  a  social  activity? 
■^^•B,  Does  he  recognize  the  uses  of  composition 

in  everyday  life? 

II.     The  AuthorVs  Style 

A.  Is  the  style  stimulating,  suggestive,  vigorous? 

B.  Is  there  sufficient  concrete  detail  to  develop 
general  concepts? 

*C.  Is  the  exposition  clear,  accurate  and  simple 
enough  to  be  readily  understood? 

■"•D.   Is  it  suited  to  the  age  of  child  for  v/hom 
it  is  intended? 
E.  Does  it  address  itself  to  the  pupil? 


III.     Proportion  and  Organization 

A.  Does  the  author  give  adequate  attention  to 

1.  The  motivation  of  expression? 

2.  The  stimulation  of  interests  and  ideas? 

3.  The  selection  and  organization  of  ideas? 

4.  The  development  of  power  of  expression? 

5.  The  habituation  of  correctness  in  speech 
and  v/riting? 

*B.  Does  the  author  give  to  oral  composition  the 
proportion  of  time  dictated  by  its  prominence 
in  the  activities  of  everyday  life? 

^C.  Does  he  give  to  letter-writing  the  emphasis 
demanded  by  its  practical  importance  in 
everyday  life. 

D.  Does  the  author  stress  the  subordinate  and 
contributory  function  of  correctness  in 
speech  and  writing  in  relation  to  the  larger 
purpose  of  expression? 

E.  Does  the  author  organize  his  material  into 
sectional  divisions  large  enough  to  stimulate 
interest,  to  give  perspective  and  to  promote 
well  rounded  growth? 

^F,  Does  the  author  organize  his  material  in 
such  a  way  as  to 

1.  Care  for  pupils  of  varying  abilities  and 
interests  within  the  same  class? 

2.  Make  both  teacher  and  pupil  conscious  of 
the  ends  toward  which  they  are  working 
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and  the  degree  of  progress  attained? 
3.  Provide  for  flexibility  in  adopting  the 
assignments  to  the  individual  classroom 
situation? 

IV.  Motivation 

•'^A.  Does  the  author  create  in  the  pupil  the  desire 
to  express  himself? 

■^•■E.  Does  he  identify  the  composition  work  of  the 
classroom  with  the  expressional  activities  of 
life  "both  within  and  without  school? 

C.  Does  he  keep  before  the  pupil  the  purpose 
of  each  activity  in  which  he  is  asked  to 
engage? 

D.  Does  the  author  stimulate  observation  and 
interest  in  a  v;ide  variety  of  subjects? 

E.  Does  he  arouse  the  initiative  and  originality 
of  the  student? 

■'^•F.  Does  he  emphasize  the  importance  of  thinking? 
Q.  Does  he  use  the  social  purpose  of  composition 
to  encourage  not  merely  correct  but  clear, 
vigorous  and  interesting  expression? 

H.  Does  he  identify  his  composition  activities 
with  actual  experience  instead  of  merely 
setting  up  series  of  topics  for  "theme  writing." 

I.  Does  he  promote  additional  activities  among 
superior  pupils? 

J.  Does  he  promote  progress  by  offering  numerous 
means  of  self-criticism: 

1.  By  providing  standards  for  the  evaluation 
of  one's  own  writing? 

2.  By  offering  bases  of  comparison  with  the 
work  of  others? 

3.  By  furnishing  means  of  comparison  with 
earlier  achievement? 

K.  Does  he  throw  the  responsibility  for  progress 
upon  the  pupil  himself? 


V.     Activities  Proposed 

A.  General  characteristics 

1.  Are  the  activities  suggested  by  the  author 
suitable  and  interesting  to  the  grade  for 
which  they  are  recommended? 

2.  Are  they  representative  of  a  v^'ide  range  of 
experience  and  thought? 

3.  Are  there  projects  suggested  which  allow 
for  class,  group  and  individual  activity? 

4.  Are  these  projects  timely,  interest  arousing 
and  thought  provoking? 

5.  Is  sufficient  direction  given  for  the 
execution  of  these  projects? 

6.  Are  the  tasks  specific,  not  general? 
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?•  Are  the  illustrations  pertinent  to  the 

pupils'  experience? 
■**'8.  Does  the  book  contain  sufficient  practice 

material  for  applying  principles  developed? 
9«  Are  the. practice  materials  so  graded  in 

difficulty  as  to  be  easily  adaptable  to 

the  needs  of  groups  and  individuals  of 

varying  ability? 

10.  Does  the  book  offer  a  wide  range  of  choice 
in  suggestions  for  assignments? 

11.  Doas  the  author  stimulate  creative  v/riting 
among  pupils  capable  of  more  literary 
achievements? 

12.  Is  there  plentiful  correlation  of  activities 
with  those  other  subjects  of  study? 

■**'B.     Does  the  text  furnish  adequate  experience  in 
the  followina:  language  activities  of  everyday 
life: 

announcements.,  book  reviewing,  conversation, 
creative  writing,  current  event  discussion, 
debating,  use  of  the  dictionary,  explaining 
or  giving  instructions,  gathering  and  report- 
ing information,  informal  discussion,  inter- 
viewing, letter  writing,  use  of  magazine 
material,  note  taking,  public  discussion 
according  to  parliamentary  form,  reporting 
speeches  or  committee  findings,  speech 
making  and  story  telling? 
C.     Does  the  author  offer  sufficient  aids  and 
devices  for 
^'■l.  Development  of  vocabulary  and  use  of 
dictionary? 
2.  Development  of  feeling  of  phrasing? 
Development  of  efficiency  in  sentence 
structure? 

4.  Selecting  and  organizing  material  before 
writing? 

5.  Outlining? 

•*^6.  Development  of  well-rounded  paragraphs? 

7.  Making  of  skilful  transitions? 

8.  Effectiveness  of  beginning  and  ending? 

VI.  The  Mechanics  of  Expression 
A .  G-rammar 

1.  Is  the  grammatical  ma.terial  motivated  by 
constant  relation  to  actual  language 
situations? 

2.  Does  the  author  provide  for  measurement 
and  stimulation  of  progress  both  for  the 
individual  and  for  the  class? 

■^3»  Does  he  provide  for  individual  diagnosis 
and  remedial  work? 
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■*^4,  Is  there  large  stress  upon  sentence  sense 

and  sentence  structure  with  repeated  review 

of  the  topic? 
^5"  Is  the  content  chosen  on  the  basis  of 

function  in  accord  with  the  findings  of 

scientific  investigations: 

a.  VYith  relatively  large  stress  on  points 
of  difficulty  as  verb  and  pronoun? 

b.  jVith  recognition  of  points  of  debatable 
usage? 

c.  With  emphasis  upon  function  not 
classification  (i.  e.  Are  classifications 
of  adverbs  into  adverbs  of  degree, 
cause,  manner  omitted  and  the  use  of  the 
a.dverb  vs.   the  adjective  stressed?  Is 
power  to  express  thought  relationships 
with  exactness  made  more  important 

than  ability  to  label  sentences  as 
compound  or  complex?) 
*6.  Is  there  ample  provision  for  repeated  drill 
upon  a  few  specific  points  instead  of 
inadequate  drill  upon  many  non-essentials? 
7.  Is  the  program  cumulative  with  adequate 
provision  throughout  for  review? 
B.  Capitalization  and  punctuation 

*1.  Are  the  requirements  limited  to  matters  of 
usage  in  our  own  day  as  revealed  by  the 
report  of  the  National  Council  of  Teachers 
of  English? 
^^2.  Are  distinctions  btstween  rcquir-cu  and 

optional  usage  clearly  made? 
^^3»  Are  ample  drill  materials  provided? 

4.  Is  the  program  cumulative  allowing  adequate 
provision  for  reviev;? 

5.  Does  the  author  provide  for  measurement 
and  stimulation  of  progress  both  for  the 
individual  and  for  the  class? 

^'■6.  Does  he  provide  for  individual  diagnosis 
and  remedial  work? 
7.  Is  there  constant  provision  for  the  use 
of  the  skills  mastered,  in  actual  writing 
situations . 

VII.  Physical  Format 

A.  Mechanical  make-up 

1.  Is  the  textbook  a  good  standard  size, 
easily  handled  by  the  pupil?  (i.e.  roughly 
5h  inches  by  7l  inches.) 

2.  Is  it  easily  opened  and  durable  in  binding? 

3.  Has  the  paper  a  non-gloss  surface? 

4.  Is  it  heavy  enough  to  insure  that  print  on 
the  obverse  side  shall  not  show  through? 
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  5»  Are  the  margins  wide  enough  to  insure 

an  uncrowded  page? 

  6.  Is  the  page  v;ell- spaced  so  as  to  eaiphasize 

outstanding  points? 

  7»  Are  the  lines  not  more  than  90  mm.  long? 

  8.   Is  the  type  dark,  plain,  and  distinct  -  not 

less  than  ten  point? 
B.  Attractiveness  and  effectiveness  of  form 

  1.  Is  the  book  attractive  in  appearance? 

  2.  Has  it  appropriate  and  effective  illustra- 
tions? 

  3«  Has  it  graphic  devices  for  aid  in  outlining, 

letter  form,  word  derivations  and  others? 
  4.  Are  the  chapter  and  section  captions  clear, 

brief,  well  spaced  and  interesting? 

  5«  Has  the  book  a  usable  index? 

  6.  Has  it  a  usable  table  of  contents? 

  ?•  Has  it  a  clear  and  impelling  preface  * 

giving  the  purpose  of  the  author  and 

suggestions  for  use? 

  C.  Does  the  copyright  date  (issued  or  revised) 

suggest  that  the  book  is  recent  enough  ta 
reflect  modern  tendencies  in  teaching?  hJ 

Improvement  of  the  sampling  technique . iVhile  the 
score  cards  were  being  improved  by  embodying  in  them  specific 
rather  than  general  pedagogical  principles,  additional 
studies  were  being  made  in  determining  grade  placement  by 
sampling,  and  older  sampling  techniques  were  being  refined. 

In  1930  G-eorge  R.  Johnson  ^  developed  a  method  of 

determining  the  difficulty  of  reading  matter  by  discovering 

the  percentage  of  polysyllabic  v;ords  in  the  selection.  He 

states  that  a  "random  sampling  of  three  thousand  words 

has  been  found  by  experiment  to  yield  a  fairly  reliable 

measure  of  difficulty  of  any  book  under  consideration." 

Another  technique  for  determining  vocabulary  difficulty 
1/  Dora  V.  Smith,  op.  cit. 

2/  G-eorge  R.  Johnson,  "An  objective  Method  of  Determining 
Reading  Difficulty,"  Journal  of  Educational  Research 
(April  1930)  21:  p.  283-28?. 


was  contributed  by  W,  W.  Patty  and  W.  J.  Painter        in  1931. 

They  listed  alphabetically  and  tabulated  the  frequen- 
cies of  all  the  words  in  the  third  full  line  of  each  fifth 
page  of  the  text  under  consideration,  except  where  there 
v;ere  pages  containing  illustrations  or  other  graphic  material, 
in  which  case  the  next  full  page  was  used. 

This  list  was  then  comoared  with  Thorndike's  2/  list 
and  the  Thorndike  index  number  was  recorded  for  each  word. 
The  investigators  then  multiplied  the  index  number  by  the 
frequency  of  the  word.     The  product  thus  obtained  v/as  the 
weighted  value  of  each  word.     They  then  computed  the  average- 
word-  weighted  value  or  arithmetic  mean  by  dividing  the 
total  weighted  values  of  all  the  words  of  the  sample  by 
the  number  of  words  in  the  sample.     This  was  done  so  that 
a  comparison  of  the  average  word  difficulty  of  a  number  of 
books  would  be  possible. 

Finally  they  computed  an  index  number  for  each  book 
by  dividing  the  average-word-weighted  value  by  the  range  of 
words  in  the  sample.     This  gave  a  ratio  of  the  different 
v/ords  to  the  difficulty  of  the  average  word.     They  concluded 
that  the  greater  the  range,  the  smaller  was  the  index 
number  and  therefore  the  greater  the  vocabulary  burden  of 
the  book  in  question. 

1/  /I/,  '/it.  Patty  and  Vii.  J.  Painter,  "A  Technique  of  Measuring 
the  Vocabulary  Burdens  of  Textbooks,"  Journal  of  Educational 
Research  (June  and  September  1931)   24:   p.  23-32  and  127-134. 

2/  E.  L.  Thorndike,  op.  cit. 


Alfred  S.  Lewerenz  'U  in  1931  published  a  chart  which 
could  be  used  to  measure  vocabulary  difficulty,  vocabulary 
diversity  and  interest,  and  from  these  obtain  the  grade 
placement  of  the  material  being  evaluated. 

On  one  side  of  the  chart  the  five  hundred  most 
important  words  of  the  English  lantruage  are  arranged 
alphabetically  with  space  for  writing  in  other  words. 

A  sample  of  one  thousand  words  taken  frpm  the  right 
end  of  the  third  line  of  nearly  all  of  the  printed  pages 
being  evaluated  are  either  crossed  out  or  v.-ritten  in  on 
this  form. 

• 

Froia  tnis  record  one  can  easily  obtain  for  each 
alphabetical  group  of  v/ords  (1)  the  number  crossed 
out  in  the  five  hundred  word  list,  (2)  the  number  o^, 
words  written  in  and  (3)   the  total  number  of  words.—/ 

Directions  on  the  other  side  of  the  chart  explain 
hov;  to  obtain  measures  of  vocabul'^.ry  difficulty,  diversity 
and  interest  from  tnis  data.     A  copy  of  this  chart  is 
contained  in  the  appendix. 

Mabel  Voixel  Morphett  and  Carle  ton  Washburne 

2/ 

continued  research  on  formulae  for  evaluating  children's 
reading  materials  after  publishing  a  report  on  their 
first  formula  in  1928.     Since  then  they  included  books 
for  primary  children  into  their  measuring  range,  refined 
1/  Alfred  3.  Lewerenz,  op.  cit. 

2/  Alfred  S.  Lewerenz,  "A  Vocabulary  Grade  Placement 
Formula,"  Journal  of  Experimental  Education  (March  1935) 
3.:  p.  236. 

3/  Mabel  Vogel  and  Carleton  Washburne,  op.  cit. 
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their  methods  and  eventually,  "arrived  at  a  more  satisfactory 
and  more  useful  formula  and  an  easier  technique  for  applying 

The  earlier  formula  had  certain  faults  which  were  not 

realized  until  later. 

First  of  all,  it  shed  no  clear  light  on  the 
grading  of  books  for  use  in  Grades  I  and  II.     In  the 
second  place,  it  required  a  preposition  count  which, 
seemingly  simple,  proved  in  practice  to  he  surprisingly 
difficult  (many  prepositions  are  very  hard  for  anyone 
not  an  expert  grammarian  to  identify).     Third,  there 
was  no  chart  form  to  simplify  the  application  of  the 
formula,  and  the  fact  that  any  of  the  ten  thousand 
commonest  words  were  considered  common  made  such  a 
chart ....  impossible.    Finally,  the  formula  did  not 
allov;  for  the  skewing  due  to  a  smaller  number  of 
ballots  in  the  upper  and  the  lovter  extremes  of  the 
original  list  and  therefore  rated  primary  books  , too 
high  and  eighth  and  ninth-grade  books  too  low,£/ 

Taking  these  four  faults  into  consideration,  a  new 

formula  was  prepared  which  consisted  of  the  following  three 

elements : 

1.  In  a  thousand  words,   from  a  systematic  sampling 
of  the  book,  how  many  different  words  are  there? 

2.  Of  this  same  thousand  v;ords,  how  many  are  not  among 
the  1,500  commonest  in  the  English  language? 

3.  Out  of  seventy-five  sentences,  sampled  systematically, 
how  many  are  neither  complex  nor  compound? 

These  are  combined  in  a  regression  formula  as  follows: 

Number  of  different  words  in  1,000  multiplied  by  .00255, 
Plus  number  of  different  uncommon  words  in  1,000 
multiplied  by  .0458, 

1/  Carleton  Aashburne  and  Mabel  Vogel  Morphett,  "G-rade 
Placement  of  Children's  Books,"  Elementary  School  Journal 
(January  1938)  38:  p.  355. 

2/  Ibid.  p.  357. 


Plus  a  constant:  1.  294, 

Minus  numlDer  of  simple  sentences  in  75  multiplied 
by  .037, 

Yields  the  grade  of  reading  ability  necessary  for 
satisfactory  reading  of  the  book.l/ 

In  order  that  the  application  of  this  formula 
might  be  made  as  easy  as  possible,  a  chart  vvaa  devised, 
patterned  somewhat  after  the  Lewerenz  chart. 
On  one  side  it  contains  the  1,500  commonest  words  in 
the  English  language,  alphabetically  arranged  and  with 
space  after  each  for  tallying  the  number  of  times  it 
occurs.     On  the  right-hand  side  of  the  same  page,  under 
letters  of  the  alphabet,  are  blanks  in  v/hich  can  be 
written  the  "uncommon"  words  found  in  a  thousand-word 
sampling  and  a  space  to  tally  the  frequency  of  occur- 
rence of  each  of  these.     Below  this  list  is  a  place 
to  enter  the  number  of  different  uncommon  words  and 
the  number  of  different  words,  both  of  which  are  needed 
in  the  formula. 

On  the  other  side  of  the  chart  are  detailed 
directions  for  the  tallying  of  the  words,  telling  what 
to  do  about  derived  forms  and  so  on;  detailed  directions 
for  selecting  the  sample  words  and  sentences;  detailed 
directions  for  recognizing  simple  sentences;  .... 
There  is  also  space  in  which  to  record,  for  the  seventy- 
five  sample  sentences,  whether  each  is  simple  or  not 
simple  in  accordance  with  the  definition  given  on  the 
chart. 

Blanks  for  copying  in  the  totals  of  each  of  these 
elements,  combined  with  the  constant  and  the  formula, 
are  also  provided  on  this  same  chart.     The  chart  makes 
it  possible  for  any  person  of  ordinary  intelligence  . 
to  analyze  any  book  and  determine  its  grade  placement.^ 

A  copy  of  this  chart  is  contained  in  the  appendix. 

G-ertrude  Whipple '  s  investigation  of  textbook  selection. — 
In  1929  G-ertrude  «Vhipple  -/  of  the  Public  Schools,  Los 
Angeles,  California,  began  a  survey  of  the  practices  followed 
1/  Carle  ton  Washburne  and  Mabel  Vogel  i^orphett,  op.   cit.  p.  359 
2/  Alfred  3.  Lev/erenz,  loc.  cit. 

3/  Carleton  'jVaoiioarni;  anJ.  ^uabel  Vogel  Llorohett,  00.  cit. 
p.  360-362. 

4/  Gertrude  IfVhipple,  "Sxcerpts  from  'Procedures  Used  in 
Selecting  School  Books,'"  Elementary  School  Journal  (May  - 
September  1936)  36:  p.  665-673,  760-775;  37:  p.  47-57- 
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in  selecting  books  for  Grades  IV,  V,  and  VI  in  cities  v;ith 
populations  of  thirty  thousand  a.nd  over,  about  ;vhich  she 
reported  in  1936. 

She  discovered  that  there  v/ere  six  types  of  procedures 

used: 

1.  Selection  based  on  the  opinion  of  all  the  staff 
members  concerned  with  the  book, 

2.  Unguided.  selection  by  the  principal  and  teachers, 

3.  G-uided  selection  by  the  principal  and  teachers, 

4.  Selection  by  central  book  committees, 

5-  Selection  by  central  curriculum  committees,  and 
6.  Selection  by  central-staff  members. i/ 

Unguided  selection  she  learned  v/as  usually  limited 
by  the  school  budi^-et  but  in  all  other  respects  the  teachers 
were  free  to  select  according  to  their  own  judgment.  In 
guided  selection  she  found  that  central  staff  members 
introduce  new  books  to  principals  and  teachers,  define 
specific  needs,  assist  principaj.s  and  teachei'-s  to  evaluate 
their  book  supply,  or  confer  with  principals  and  teachers 
as  they  make  their  choice;s. 

In  surveying  the  methods  of  evaluating  textbooks 
she  decided  that  book  selection  is  in  a  definite  stage  of 
trial  and  error.     Of  the  schools  responding  to  her  survey 
practices  varying  from  briefest  consideration  of  books  to 
elaborate  analysis;   from  questionable  to  sound  practices; 
and  from  altogether  subjective  to  scientific  steps  in 
selection  were  reported.     As  a  result  the  following  con- 
clusions were  derived: 
1/  G-ertrude  Vvhipple,  op.   cit.   p.  665. 
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1.  Many  valuable  methods  of  securing  titles  for  examina- 
tion are  in  use.     However  only  a  few  cities  employ 
systematic  methods  of  handling  samples  and  related 
information.     Since  many  new  books  are  published 
every  year,  the  development  and  the  use  of  systematic 
methods  are  essential  to  efficient  selection. 

2.  The  specific  types  of  books  needed  are  rarely 
determined  before  evaluating  materials.  The 
importance  of  determining  needs  is  evident  in  view 
of  the  wide  variations  in  pupil  achievements  in 
Grades  IV,  V  and  VI. 

3.  The  stanj.ara&  of  evaluation  reported  vary  widely. 
They  include  highly  objective  items  as  well  as  items 
that  are  entirely  subjective.     The  score  cards 
range  from  brief  lists  of  general  items  to  elaborate 
scales  containing  carefully  weighted  standards. 
These  findings  show  the  need  for  developing 
additional  objective  standards  for  evaluating  books, 

4.  Numerous  methods  of  evaluation  are  in  use.  Some 
are  concerned  with  the  general  merit  of  books  and 
others  with  specific  characteristics.     Some  provide 
for  careful  analysis  of  books  and  others  for  super- 
ficial inspection.     It  is  evident  that  much  scientific 
work  remains  to  be  done  in  this  field. 

5.  Current  practices  fail  to  insure  the  selection 
of  books  adapted  to  specific  teaching  purposes. 
There  is  therefore  need  for  careful  analysis  of 
the  purposes  which  books  should  serve  in  fulfilling 
the  aims  of  the  course  of  study. 

6.  Few  methods  of  determining  recommendations  were 
reported.     Those  described  gav,e  little  information 
on  specific  techniques  used.=/ 


1939  to  19^5 

This  period  proved  to  be  the  least  progressive  of  the 
three.     In  fact  no  noticeable  advancement  has  been  made 
in  any  of  the  techniques.     It  is  true  that  additional  score 
cards  were  prepared  in  the  fields  of  mathemati  and 

1/  Gertrude  Vihipple,  op.  cit.  p.  774-775. 

2/  C.  B.  Read,  "Selection  of  Mathematics  Texts,"  School 
Science  and  Mathematics  (December  1942)  42:  p.  809-812. 


science        and  one  rating  device  was  developed  which  could 
"be  used  as  a  guide  for  selecting  any  type  of  textbook,  but  as 
a  whole  it  could  not  be  seen  where  these  ratine  scales  were 
any  improvement  over  those  produced  during  the  last  decade. 

The  "G-uide  for  Textbook  Analysis"  which  has  been  selected 
as  representative  of  this  period  was  prepared  in  19^1  by 
Willis  0.  Underwood-        Assistant  Professor  of  Education  at 
the  University  of  Colorado. 

As  a  preliminary  study  he  sent  out  465  questionnaires 

to  teachers  inquiring  about  what  criteria  they  used  when 

evaluating  textbooks;  arranged  for  264  personal  interviews 

with  members  of  textbook  committees  for  the  purpose  of 

gathering  the  same  information;  and  critically  examined 

seven  textbook  score  cards  2./  which  had  received  sufficient 

1/  H.  J.  Davis,  "Criteria  for  Selecting  Science  Books," 
School  Science  and  Mathematics  (April  1942)  42:  p.  360-364. 

2/  Willis  0.  Underwood,  "G-uide  for  Textbook  Analysis," 
American  School  Board  Journal  (March  1941)  102:  p.  23-24. 

3/    A.  G-ertrude  V<liipple,  "items  Considered  in  Selecting 

Textbooks  '."hen  Score  Cards  Are  Used,"  Elementary  School 
Journal  (1935)  36:  p.  665-673. 

B.    "items  Considered  in  Selecting  Textbooks  for 

State  Adoptions,"  Elementary  School  Journal  (1937) 
37:  p.  47-57. 

C.    "items  Considered  in  Selecting  Textbooks  V.hen 

Score  Cards  Are  Not  Used,"  Elementary  School  Journal 
(1935)  36:  p.  764-765. 

D.  C.  R.  Maxwell,  op.   cit.  p.  76-83. 

E.  S.  E.  Burr,   "Selection  of  Textbooks  and  the  Use  of 
Textbook  Rating  Scales,"  American  School  Board 
Journal  (1929^)  79:  p.  130. 

F.  Committee  Report,  "East  St.  Louis  Provides  Teachers 
iiVith  Outline  for  Picking  Books,"  American  School 
Board  Journal  (1929)  78^:  p.  160. 

G-.  Leland  3.  Jacobs,  op.   cit.  p.  485-486. 
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recognition  to  be  published  in  educational  journals. 

From  the  combined  criteria  acquired,  he  formulated 
his  "guide,"  which  he  suggests  should  be  used  as  "directed 
study"  to  call  to  the  examiner's  mind  points  which  should  not 
be  ignored  when  faced  with  the  task  of  selecting  textbooks. 


A  G-uide  for  Textbook  Analysis 


I.  Authorship 


1.  Training 

2.  Experience 
3«  Reputation 

4.  Authority 

5.  Participation  in  scientific  investigations 

II.  Content  and  Organization 

1.  In  harmony  with  educational  aims 

2.  Teachable  organization 

3.  Scientific  basis  for 

4.  Consistent  point  of  view 

5.  Adequately  covered  field 

6.  Modern  character  of  situations 
?•  Balance  of  content 

8.  Accuracy 

9.  Psychological  approach 

10.  Organized  around  large  themes 

11.  Tested  in  classroom 

12.  Correlated  with  other  pupils 

13.  Meet  needs  of  pupils 

14.  Meet  needs  of  community 

15.  Sound  sequence  of  material 

16.  Develop  proper  attitudes,  habits  and  skills 

17.  Obsolete  topics  eliminated 
13.  Material  not  biased 

19«  Possible  omission  of  material  without  destroying  sequence 

20.  Organized  within  selections 

21.  Material  suited  to  age  of  child  (grade  placement) 

22.  Adequate  details 

23.  Correct  standards  and  ideals  in  use  of  English 


III.  Vocabulary  and  Readability 


1.  Controlled  vocabulary 

2.  Concepts  on  level  of  child 

3.  Style  clear  and  lucid 

4.  G-ood  sentence  structure 

5.  Provision  for  vocabulary  enrichment 


IV.  Method  and  Motivation 


1.  Interesting  material 

2.  Activity  program 

3.  Emphasis  on  thinking,  creative  work 

4.  Well  illustrated 

5.  Develop  general  principles  and  major  understandings 

V.  Teaching  and  Study  Aids 

1.  Teachers'  manuals  and  guides 

2.  Tests  to  accompany  book 

3.  Testing  program  within  book 

4.  Workbook  to  accompany  book 

5.  Index 

6.  Appendix 

7.  G-lossary 

8.  Table  of  contents 

9.  Summaries 

10.  Marginal  notes 

11.  References 

12.  Maps,  charts,  tables,  statistics 
13 •  Reviews,  (simple  and  cumulative) 

14.  Provision  for  individual  differences 

15»  'Questions,  exercises  and  drills 

VI.  i\/Iechanical  Make-up 

1.  Print 

2.  Spacing  of  words  and  letters 

3.  Paper 

4.  Width  of  margins 

5.  Bindings 

6.  Shape 

7»  Washable  backs 

8.  Attractiveness 

9.  Durability 

10.  Length  of  line 

11.  Page  arrangement 

12.  Size  of  book 

VII.  Miscellaneous 

1.  Copyright  date 

2.  Student  opinions 

3.  Price 

4.  Fit  course  of  study 

5.  Publisher 

6.  Opinion  of  others  (number  of  adoptions) 


It  is  the  author's  opinion  that  this  "guide"  should 

••••  eliminate  the  objections  leveled  against  many 
score  cards  because  it  is  not  sponsored  by  any 
publishing  house,  it  is  not  the  opinion  of  one  man 
or  one  group,  and  it  is  not  weighted  on  the  assumption 
that  one  set  of  weightings  are  equally  applicable 
to  every  community  in  the  United  States.     It  does 
include  contributions  from  a  wide  variety  of  teachers 
and  supervisors  in  large  and  small  schools  in  several 
states  and  it  also  includes  the  findings  of  groups 
who  have  produced  recognized  score  cards. i/ 

As  there  were  no  further  developments  of  either  sampling 
or  complete  v/ord  count  techniques,  they  shall  not  be  men- 
tioned further  in  this  section. 

However  one  interesting  plan  for  teacher  participation 
in  the  selection  of  textbooks  was  reported  by  Clara  K.  Sterk 
and  Beatrice  Purdy.  2/    This  plan  was  first  proposed  in 
Milwaukee  where  it  was  successfully  carried  out. 

The  "Committee  of  xRules"  in  Llilwaukee  in  endeavoring 
to  work  out  a  plan  for  selection  of  textbooks  were  beset 
v;ith  the  following  problems: 

(1)  how  to  provide  for  a  definite  periodic  re-exam- 
ination of  textbooks  in  use,  by  the  teachers 
using  them, 

(2)  how  to  provide  for  active  participation  by  the 
classroom  teachers  in  the  selection  of  textbooks, 

(3)  how  to  provide  ample  time  for  the  study  and 
evaluation  of  textbooks  to  be  considered  for 
adoption  by  the  teachers  who  are  to  use  them,  and 

(4)  how  to  provide  publishers'  representatives  with  , 
an  opportunity  to  present  their  books  to  teachers.!/ 

1/  ,Villis  0.  Underwood  op.   cit.  p.  24 

2/  Clara  K.  Sterk  and  Beatrice  Purdy,  "A  Plan  for  Teacher 
Participation  in  Selection  of  Textbooks"  Elementary 
School  Journal  (May  1941)  41:  p.  658-664. 


3/  Ibid.  p.  659 


A  committee  representing  teachers,  principals  and 
the  superintendent  was  set  up  known  as  "Textbook  Advisory 
Committee"  consisting  of  fifteen  members  for  a  term  of 
three  years  each.     Their  terms  of  office  were  so  arranged 
that  at  the  most  there  could  be  only  seven  nev/  members 
inducted  at  one  time. 

This  group  sends  out  a  questionnaire  to  each  teacher 
in  the  system  not  later  than  the  first  of  June  each  year, 
on  which  he  may  vote  for  or  against  the  continuation  of 
textbooks,  the  use  of  which  may  be  legally  discontinued 
at  the  end  of  the  next  current  school  year. 

The  Board  of  School  Directors  then  specifies  the 
subjects  which  shall  be  considered  open  for  adoption,  and 
a  notice  is  sent  to  textbook  representatives,  who  at  a; 
general  meeting  present  the  merits  of  their  books  to  the 
teachers  concerned.     Before  this  meeting  teachers  have  had 
ample  time  to  examine  sample  copies  of  each  book  to  be 
presented. 

As  all  teachers  are  not  capable  of  determining  the 

needs  for  every  subject,   subject  committees  are  selected 

to  evaluate  objectively  all  available  textbooks  in  their 

subject  and  decide  on  not  more  than  five  of  the  most 

desirable  books  to  be  submitted  to  a  vote  of  the  teachers. 

After  the  five  textbooks  have  been  determined 
for  the  teacher  vote,   the  teachers  vote  directly  for 
the  textbooks  which  they  believe  meet  most  adequately 
the  needs  of  the  children.... 

The  results  of  the  votes  are  sent  by  each  text- 
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book  subject  committee  as  a  sealed  report  to  the 
Board  of  School  Directors,  to  be  referred  to  the 
superintendent  for  his  comments  and  to  be  sent 
by  him  to  the  Committee  on  Instruction  for  its 
recommendation  to  the  Board  of  School  Directors. 

Final  action  on  textbook  adoption  is  then 
taken  by  the  board  of  School  Directors....—''^ 

This  program  is  set  up  to  pive: 

1.  A  definite  procedure  for  ascertaining  which  textbooks 
teachers  v/ould  recommend  for  change. 

2.  A  periodic  re-examination  (every  five  years)  by 
teachers  to  determine  the  usability  of  each  textbook. 

3.  A  three  month  period  in  which  to  study  and 
analyze  textbooks  to  be  voted  on. 

4.  An  objective  analysis  of  each  of  five  textbooks 
submitted  by  the  textbook  aubject  committee  for 


the  vote  of  the 


1/  Clara  K.  Sterk  and  Beatrice  Purdy,  op.  cit.  p.  662. 
2/  Ibid.  p.  664. 


CHAPTER  III 

CONCLUSIONS 


At  the  beginning  of  the  twentieth  century  when  devious 
practices  were  being  resorted  to  in  an  a.ttempt  to  sell 
inferior  textbooks,  such  educators  as  C.  R.  Maxv/ell,  1/ 
Alfred  Lawrence  Hall-Q.uest ,       R.  H.  Franzen,  F.  B.  Knight, 
and  E.  .M.  Otis,      each  resolved  that  something  should  be 
done. 

Their  solution  to  the  problem  took  the  form  of  score 
cards  bj  which  the  books  could  be  rated.     A  criticism 
which  might  be  made  of  these  early  score  cards  is  that 
they  were  too  general. 

When  these  score  cards  were  published  others  were 

developed  to  remedy  defects  noticed  in  them.     Some  attempts 

were  made  to  prepare  a  score  card  which  would  be  adaptable 

to  any  type  of  textbook  being  selected  and  to  any  situation; 

while  others  were  prepared  to  be  used  for  specific  subjects 

1/  C.  R.  Maxwell,  loc.  cit. 

2/  Alfred  Lav/rence  Hall-^uest,  loc.  cit. 

3/  R.  H.  Franzen  and  F.  B.  Knight,  Textbook  Selection 
Baltimore,  1922.  9^  p. 

4/  E.  HI.  Otis,  "A  Textbook  Score  Card,"  Journal  of  Educa- 
tional Research,  (February  1923)  7i  p.  132-136. 
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in  specific  situations.     In  some  weights  v^ere  added  to  the 
elements  involved  so  that  a  numerical  score  could  he 
obtained.     This  was  later  considered  to  be  more  of  a  det- 
riment than  an  advantage. 

In  the  I93O3  many  score  cards  were  prepared,  all  a 
vast  improvement  over  the  first  ones,  all  embodying  def- 
inite principles  and  endeavoring-  to  meet  the  felt  needs 
of  the  community,  but  all  nevertheless  very  much  at  the 
same  level  of  progressiveness . 

Apparently  whenever  a  situa.tion  arose  in  v/hich  it  was 
necessary  to  evaluate  textbooks,  a  special  com;riittee  was 
formed  which  produced  a  scoring  device  to  fit  their  own 
particular  situation  without  referring  to  any  previous 
studies  made  in  this  field. 

It  seems  to  be  very  obvious  that  a  series  of  objective 
score  cards  should  be  prepared  containing  minimum  standards 
essential  for  every  subject  taught  ana  that  these  should 
be  made  available  to  all  teachers,  and  others  such  as 
librarians  who  are  in  any  way  connected  v/ith  the  evaluation 
of  reading  materials. 

To  do  this  would  require: 

1.  The  gathering  of  all  available  score  cards. 

2.  Distributing  them  to  subject  committees  composed  of 
representatives  of  all  sections  of  the  country/. 

3.  Tabulation  by  each  committee  of  the  criteria  found 
in  the  available  score  cards. 


4.  Formulation  of  a  master  score  card  for  each  subject 

retaining  all  worthwhile  criteria  and  adding 
new  criteria  which  seems  pertinent  to  a  majority 
of  the  committee. 

5.  Publishing  this  series  of  master  score  cards  which 
may  be  used  to  rate  any  text  used  in  any  subject 
from  G-rades  I  through  XII. 

6.  Making  this  series  of  score  cards  available  to  all 
schools  and  to  all  publishers  for  either  no  or  a 
very  low  cost. 

7.  Planning  for  meetings  of  the  subject  committees 
at  least  every  five  years  to  make  changes  or 
re^'isions  in  the  score  cards. 

Other  educators  recognized  a  different  problem  in 
connection  with  the  evaluation  of  reading  materials. 
W.   »V.  Patty  ,        J.  Painter,      Alfred  S.  Lewerenz,  2/ 
Carle  ton  iVashburne,  i^abel  Vogel  Morphett,       and  others 
felt  that  the  vocabulary  of  the  textbook  must  be  suited  to 
the  reading  level  of  the  child  to  provide  the  best  learning 
situation.     They  therefore  made  studies  by  taking  samples 
of  vocabulary  and  in  som.e  cases  complete  word  counts  of 
texts  to  arrive  at  their  grade  placement.     The  most  complete 
1/  W .  'ii .  Patty  and  W.  J.  Painter,  loc.  cit. 
2/  Alfred  3.  Lewerenz,  loc.  cit. 

3/  Carleton  A'ashburne  and  Mabel  Vogel  Aiiorphett,  loc.  cit. 


of  these  studies  were  made  by  Alfred  Lewerenz,  and  Mabel 
Vogel  Morphett  and  Carleton  rtashburne.     They  prepared  charts 
and  formulae,  and  by  followina;  their  directions  carefully 
any  teacher  may  statistically  find  the  grade  placement  of 
any  of  her  texts. 

If  one  of  these  formulae  could  be  used  in  connection 
with  the  series  of  score  cards  previously  referred  to,  so 
that  for  every  subject  taught  there  would  be  textbooks 
provided  for  four  or  five  different  reading  levels  it  seems 
that  the  maximum  teaching-learning  situation  would  be  attained* 

The  actual  selection  of  textbooks  has  improved  through 
the  years  in  that  at  the  present  time  teachers  are  being 
given  more  of  an  opportunity  to  recommend  texts  for  their 
specific  classroom  situations  than  they  were  formerly. 

A  still  better  method  would  be  to  have  in  every  city 
a  textbook  selection  committee,   trained  in  the  use  of 
score  cards  and  vocabulary  formulae,  who  would  be  informed 
on  all  of  the  latest  developments  in  textbooks  and  could 
give  all  teachers  expert  advice  whenever  any  situation 
arose  in  which  it  v/as  needed. 

This  would  put  textbook  selection  and  evaluation  on 
a  scientific  basis  and  remove  it  from  the  haphazard, 
guess-work  rut  it  is  in  today. 
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APPEIiDIX 


COPY 

Board  of  Education 

of  the 

City  of  Los  Angeles 

Chamber  of  Commerce  Building 
Los  Angeles  15,  California 

March  9,  19^5 


Miss  Frances  M.  Buckley 

14  Puritan  Road 

North  Beverly,  Massachusetts 

Dear  Miss  Buckley: 

In  response  to  your  letter  of  March  5,  I  am  send- 
ing yo^>  under  separate  cover,  four  evaluation  sheets 
for  use  in  connection  with  the  vocabulary  grade  place- 
ment formula.     Also  included  are  copies  of  the 
supplementary  directions  and  the  interest  v/ord  list. 

As  there  is  no  charge  for  this  material,  I  am 
returning  to  you  your  postal  money  order  for  one 
dollar. 


Very  truly  yours. 


Alfred  3.  Lewerenz 
Supervisor 

Educational  Research  and 
Guidance 
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End. 
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DIRECTIONS  FOR  USING  THIS 
SHEET 


I  LAYOUT 
I  of  tliis  sheet  a 


lade  up  : 


1  alphabetical  list  of 
nrds*  spaced  to  per- 
i  1,000  additional 


The  two  s 
follows: 
A.  On  the  reverae  sid( 
the  500  most  comn 
mit  -writing  in  !i3 

words  in  alphabetical  order,    mere  i»  -nou 
space  for  entering  identifying  data  for  the 
reading  matter  being  evaluated  and  indicat- 
ing the  status  of  the  evaluation. 
6.  On  this  side  are : 

1.  Directions  for  using  this  sheet 

2.  The  vocabulary  grade  placement  formula 

3.  Tabulation  column  for  word  totals  by  ini- 
tial lettei-s,  divided  into  tliree  columns: 

a.  Number  of  words  crossed  out 

b.  Number  of  words  written  in 

c.  Total  number  of  different  words 

4.  Space  for  ;i  summary  of  difficulty  data  for 
index  letters  as  follows: 

a.  Totals  transferred  from  tabulation  col- 
umn at  left  of  page 

b.  Per  cent  each  index  letter  totil  is  of 
the  grand  total  of  different  words 

c.  Value  for  each  index  letter 

5.  Table  for  conveiting  index  letter  percent- 
ages into  corresponding  values 

6.  Space  for  finding  vocabulary  diversity 
percentage  which  is  the  ratio  between 
the  number  of  words  crossed  out  and  the 
grand  total  of  different  words 

7  Table  for  converting  vocabulary  diver- 
sity percentage  into  vocabulary  diversity 
grade  placements 

8.  Table  for  finding  vocabulary  interest 
rating 

II  PROCEDURE  FOR  USING  SHEET 
The  following  steps  should  be  taken  in  finding 
the  vocabulai-y  difficulty,  the  vocabulary  di- 
veraity  and  vocabulary  interest  of  a  given 
selection  of  reading  matter: 

A.  Selecting  Words.  The  number  of  different 
words  in  1,000  words  is  found  by  taking 
a  sampling  from  the  right  end  of  the  third 
line  (either  top  or  bottom)  of  approximately 
all  printed  pages  of  the  material  being  eval- 
uated. For  example:  If  a  book  has  250 
pages,  4  words  from  the  third  line  on  every 
page  would  need  to  be  iaVen  to  yield  the 
necessary  1.000  words. 

B.  Entering  Words  on  Tabulation  Sheet.  Each 
word  is  recorded  in  alphabetical  order  on 
the  reverse  side  of  this  sheet.  Words  found 
in  the  printed  list  are  crossed  out.  Other 
words  are  written  in.  Each  word  is  recorded 
but  once. 

In  entering  words  the  following  points  should 
be  observed : 

1.  Proper  nouns  are  included  as  regular 
I  words. 

2.  Hyphenated  words  are  counted  as  two 
words  where  each  can  stand  alone  in 

I  the  sense  in  which  used.    For  example, 

"Heart-free"  is  counted  as  two  words,  but 
"Pan- American"  is  counted  as  one  word. 

3.  Derived  forms  of  a  given  word  are  not 
counted  as  separate  words.  In  case  of 
doubt  whether  to  record  a  word  as  dif- 
ferent from  some  fonn  already  tabulated, 
Webster's  Dictionary,  preferably  the  un- 
abridged edition,  should  be  consulted. 
For  example:  If  the  word  "have"  has 
been  recorded  and  "having"  is  encoun- 
tered, reference  to  the  dictionary  shows 
that  "having"  is  a  derived  form  and  is 
included  in  tlie  definition  under  "have." 

C.  Calculating  the  Vocabulary  Difficulty. 

The  following  steps  are  taken  in  finding  the 
difficulty  of  the  vocabular>' 
1.  The  sampling  having  been  made,  the 
number  of  different  words  beginning  with 
"A,"  "B,"  "C."  "D,"  etc.  is  recorded  in 
the  tabulation  column  on  the  left  of  this 
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Number  of  Interest  Words 
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Per  Cent  Interest  Words  are  to 
Grand  Total  of  Words     .    .  . 

Vocabulary  Interest  Rating  .  . 


5.  The  values  for  the  "E,"  "E,"  "H,"  "I," 
and  "W"  per  cents  are  found  bv  consult- 
ing the  "Table  of  Converting  Index  Letter 
Per  Cents  Into  Values."  In  the  case  of 
"B"  words  just  cited,  a  value  of  118  is 
found  for  3.75  per  cent.  Whenever  pos- 
sible, values  slioutd  be  interpolated  as  it 
is  necessary  to  do  in  order  to  get  a  value 
of  118  for  a  "B"  percentage  of  3.73. 

6.  After  the  values  for  all  five  of  the  index 
letters  are  found,  they  are  totaled  and 
multiplied  by  .02.  The  product  is  the 
vocabulaiT  difficulty  grade  placement. 
Thus,  if  the  values  for  the  five  letters  are 
respectively  100,  95,  110,  81,  and  98,  the 
total  will  be  484.  The  sum  multiplied  by 

.02  gives  a  vocabulary  difficulty  grade 
placement  of  9.68.  When  found,  the  dif- 
ficulty grade  placement  of  a  selection  of 
reading  matter  should  be  recorded  in  the 
space  provided  on  the  reverse  side  of  this 
sheet. 

D.  Calculating  the  Vocabulary  Diversity. 

Using  the  space  in  lower  left  hand  corner  of 
this  page,  the  following  steps  are  taken  in 
finding  the  diversity  of  the  vocabulary. 

1.  The  total  number  of  words  crossed  out  is 
divided  Ijy  the  jrrand  total  of  different 
words  to  find  the  Vocabulai-y  Diversity 
percentage. 

2.  The  vocabulary  diversity  grade  place- 
ment is  found  by  consulting  the  "Table 
for  Converting  Diversity  Per  Cents  into 
Grade  Placements."  Thus,  if  a  selection 
lias  a  total  of  427  different  words  of 
which  222  are  words  crossed  out,  the  vo- 
cabulary diversity  per  cent  is  52.  The 
diversity  grade  placement  of  52%  is  3.8. 
When  found,  the  diversity  grade  place- 
ment of  a  selection  of  reading  matter 
should  be  recorded  in  the  space  provided 
on  the  reverse  side  of  this  sheet. 

E.  Calculating  the  Vocabulary  Interest  Rating. 
Vocabulary  interest  is  found  with  the  aid  of 


Per 

Cent   

Vocab. 
Diversity 
Gr.  PI  


pape 


s  follow 


,  Words  crossed  out  for  each  letter 

b.  Words  written  in  for  each  letter 

c.  The  total  of  the  two  for  each  letter 

2.  By  adding  the  totals  for  "c,"  the  grand 
total  is  secured.  This  should  check  with 
the  sum  of  the  totals  of  words  crossed  out 
and  words  written  in. 

3.  The  totals  for  "B,"  "E,"  "H,"  "I,"  and 
"W"  words  are  entered  in  the  section 
headed  "Summary  of  Difficulty  Data  for 
Index  Letters." 

4.  Each  of  the  totals  for  "B,"  "E,"  "H,"  "I," 
and  "W"  words  is  divided  by  the  grand 
total  of  different  words  which  gives  the 
per  cent  of  each.  This  figure  should  be 
carried  to  the  nearest  hundredth  per  cent. 
Thus,  if  a  selection  yields  a  grand  total 
of  427  different  words  in  a  1,000  words 
and  16  of  tliese  are  "B"  words  the  per 
cent  for  "B"  words  is  3.75. 


the  Vocabulary  Interest  Check  List.  This 
a  mimeographed  list  of  selected  adjectives 
and  adverbs  appearing  in  the  "Teacher's 
Word  Book"  by  Edward  L.  Thomdike.  These 
words  are  all  inherently  descriptive.  They 
.  add  color  and  life  to  written  material. 
To  calculate  the  vocabulary  interest  rating 
find  the  number  of  words  written  in  or 
crossed  out  that  are  given  in  the  Check 
List.  This  step  may  be  done  by  circling 
with  a  colored  pencil  each  word  on  the 
Tabulation  Sheet  found  also  on  the  Check 
List. 

The  total  number  of  interest  words  should 
be  recorded  in  the  space  provided  above. 
Then  find  what  per  cent  the  total  of  in- 
terest words  is  to  the  grand  total  of  words 
and  record  the  percentage. 

The  percentage  of  interest  words  may  be 
converted  into  a  ratinjT  by  means  of  the 
table  at  the  foot  of  this  column.  For  ex- 
ample, a  sheet  with  a  grand  total  of  425 
words  has  34  interest  words  circled  or  8 
per  cent  of  the  total.  Reference  to  the 
table  shows  that  8  per  cent  gives  an  In- 
terest Rating  of  "Average." 

Ill  INTERPRETATION  OF  DATA 

A.  Vocabulary  Difficulty.  The  difficulty  place- 
ment secured  indicates  the  degree  of  reading 
comprehension,  as  measured  by  the  "Stan- 
ford Achievement  Test,  Reading  Examina- 
tion," necessary  to  understand  the  vocabu- 
lary used  in  the  work  examined. 

The  reading  difficulty  of  poetry  that  has  sub- 
tle meanings  and  other  matter  containing  in- 
direct references,  analogies,  and  cryptic  or 
highly  involved  statements  is  not  measured 
by  a  vocabulary  difficulty  formula.  How- 
ever, in  the  majority  of  cases  where  a  sam- 
pling has  been  made  from  an  entire  book, 
the  method  described  proves  effective. 

B.  Vocabulary  Diversity.  The  vocabulary  di- 
versity grade  placement  is  secondary  to  the 
vocabulary  difficulty  grade  placement.  Its 
chief  use  is  in  comparing  two  or  more  books 
that  have  approximately  the  same  vocabu- 
lary difficulty  gi-ade  placement.  Vocabulary 
diversity  is  an  indication  of  the  range  of 
words  used  without  respect  to  their  diffi- 
culty. However,  of  two  books  having  Un 
same  difficulty  grade  placement,  the  one 
with  the  higher  diversity  grade  placement 
may  be  regarded  as  being  more  difficult. 

C.  Vocabulary  Interest.  The  Vocabulary  Inter- 
est Rating  is  a  rough  measure  of  the  extent 
to  which  an  author  has  employed  colorful, 
descriptive  words  to  aid  in  developing  his 
meanings.  Books  with  a  "Superior"  ratinE 
tend  to  be  more  enjoyed  than  those  with 
an  "Inferior"  rating.  The  rating  must  be 
interpreted  in  conjunction  with  Vocabulary 
Interest  and  Diversity,  when  picking  a  book 
for  a  given  pupil  or  grade. 


•Willis  W.  Clark,  A  Spelling  Dictionary  for  Ele- 
mentary School  Pupils.  Los  Angeles  City 
Schools,  1928,  62  pp. 


Very  Inferior 
Inferior 
Average 
Superior 
Very  Superior 


LOS  ANGELES  CITY  SCHOOL  DISTRICT 
DIVISION  OF  INSTRUCTION  AND  CURRICULUM 
EDUCATIONAL  RESEARCH  AND  GUIDANCE  SECTION 

The  Vocabulary  Grade  Placement  Formula  for  Difficulty  and  Diversity 
and  Rating  for  Vocabulary  Interest 


The  difficulty  of  a  given  selection  of  reading  matter 
may  be  occasioned  by  several  factors  of  which  vocabu- 
lary is  usually  one.  The  same  thought  may  be  expressed 
■  iple  or  difficult  words,  according  to  the  style  of  the 
author.  A  given  selection  may  be  easy  or  hard,  depend- 
on  the  reader's  own  vocabulary  comprehension. 
An  author  may  be  inclined  to  write  in  a  dull  man- 
ner, using  few  descriptive  words.  On  the  other  hand, 
he  may  employ  many  image-bearing  words  to  create 
iorful  and  interesting  literature. 
The  purpose  of  the  formula  described  below  is  to 
compare  a  given  book  or  article  with  a  known  scale  of 
ocabulary  difficultj', 

Sfx  uses  for  a  vocabulai-y  grade  placement  fomiula 
may  be  pointed  out: 

Selection  of  textbooks  which  will  be  appropriate 
to  the  grade  in  which  they  will  be  used. 


2.  Selection  of  readers  which  in  difficulty  will  fit 
the  needs  of  specific  grade  groups. 

3.  Selection  of  supplementary  reading  materials  for 
dull  over-age  pupils  and  young  pupils  of  superior  men- 
tality. The  latter  group  usually  needs  stories  with  a 
juvenile  theme  but  written  with  a  somewhat  mature 
style,  while  the  former  group'  enjoys  books  with  a 
theme  suited  to  its  social  maturity  but  told  in  a  very 

4.  Measurement  of  the  compositions  of  children  to 
fonn  a  basis  for  estimating  their  knowledge  of  words, 

5.  Checking  for  difficulty  vocabularies  used  in  spell- 
ing lists  to  keep  them  balanced  and  within  the  grade 
level  where  used. 

6.  Enabling  librarians  to  recommend  more  ef- 
fectively books  to  teachers  who  wish  to  supply  their 
children  with  recreational  reading  materials  fitted  to 
their  comprehension  level. 


Table  for  Convertmg  Index  Letter  Per  Cents  Into  Values — (Revised  2-1-35) 


A.  Vocabulary  Difficulty 

■  has  been  found  by  careful  experimentation  that 
cei-tain  letters  have  a  tendency  to  begin  easy  words, 
notably  B,  H,  and  W.  Others,  especially  E  and  I,  are 
the  first  lettei-s  of  hard  words  in  a  large  proportion  of 
■ases.  If  a  dictionary  is  consulted  it  will  be  found  that 
here  is  usually  a  marked  difference  in  difficulty  be- 
.ween  different  letter  groups  of  words,  as  for  instance, 
between  the  I  and  W  words. 

Books  that  are  read  by  young  pupils  have  a  high 
percentage  of  words  beginning  with  B,  H,  and  W,  and 
low  percentage  of  E  and  I  words.  Books  read  by 
ore  mature  readei"s  are  found  to  have  an  increasing 
^  jrceiitage  of  E  and  I  words  and  a  decreasing  percent- 
age of  B,  H,  and  W  words. 

The  scale  of  index  letter  values  used  in  this  formula 
orginally  based  upon  the  material  provided  in  the 
reading  sections  of  the  "Stanford  Achievement  Test." 
These  sections  were  broken  up  into  reading  age  lev- 
1  accordance  with  the  noi-ms  supplied  with  the  test. 
Distributions  of  the  different  words  beginning  with  B, 

B,  H,  L  and  W  were  made  for  each  grade  through  tiie 
twelfth. 

Early  in  1935  a  study  was  made  to  determine 
hether  there  were  any  index  letters  other  than  B,  E, 
H,  I,  and  W  that  might  be  utilized.  The  word  weights 


II  DERIVATION 

given  in  "A  Study  of  English  Word-Values"  by  Law- 
rence Faucett  and  Itsu  Maki  were  utilized  in  this  con- 
nection. Words  beginning  with  "C,"  "P,"  and  "T" 
seemed  to  have  some  predictive  ability.  New  norms 
were  calculated  using  as  a  basis  the  data  from  three 
hundred  and  eighty-two  books  of  known  difficulty. 

Coefficients  of  correlation  were  calculated  using  (1) 
the  old  norms,  (2)  the  new  norms  with  the  original  five 
letters  and  (3)  the  new  norms  with  the  eight  lettei-s. 
The  best  results  were  secured  using  the  new  norms  with 
"B,"  "E,"  "H,"  "I,"  and  "W."  (See  Section  III  below) 


B.  Vocabulary  Diversity 

The  grade  placements  for  vocabulary  divei-sity  were 
derived  as  follows: 

1.  Approximately  200  tabulation  sheets  were  sorted 
by  Vocabularj'  Grade  Placement  Difficulty. 

2.  For  each  sheet  the  per  cent  of  crossed  out  words 
to  the  grand  total  was  found. 

3.  For  each  grade  a  distribution  of  per  cents  for  all 
the  sheets  was  made. 

4.  For  each  grade  the  average  per  cent  was  found, 

5.  The  average  per  cents  were  interpolated  to  give 
grade  placements  by  percentiles.  (See  table  below.) 


The  formula  has  been  tested  for  reliability  by  secur- 
ing two  grade  placements  for  each  of  a  number  of  rep- 
resentative books  and  other  types  of  reading  material. 
The  reliability  of  grade  placemeftts  depends  on  the 
quality  of  the  sampling  made.  It  often  happens  that 
when  two  samplings  are  made  that  cei-tain  material  will 
"ncluded  in  one,  such  as  directions,  which  will 
not  be  found  in  the  other.  Variations  between  two 
grade  placements  on  the  same  book  may  be  caused  by 
dissimilarity  in  the  content  of  the  book.  Experience 
has  shown  that  variations  on  elementary  school  books 
may  range  from  0.02  of  a  year  to  1.00  year  with  an 
average  deviation  of  0.46  of  a  year. 

With  books  of  university  caliber,  the  variations  may 
range  from  0.26  of  a  year  to  1.86  yeais.  The  average 
deviation  of  such  books  in  actual  practice  has  been 
slightly  more  than  1.00  year. 

For  all  books  examined  ranging  from  primers  to 
works  on  philosophy,  the  average  deviation  was  0.65 
of  a  year. 

A  Pearson  product-moment  r  of  .89  *  .02  originally 


m  RELIABILITY 

was  found  for  pairs  of  difficulty  grade  placements  de- 
rived from  83  books.  Vocabulary  divereity  on  the  same 
books  had  a  reliability  of  .96  *  .01. 

More  recently  a  coefficient  of  reliability  has  been 
calculated  utilizing  the  split-half  method.  Using  the 
revised  norms  for  Vocabulary  Difficulty  with  data  from 
forty  evaluated  books  a  correlation  was  made  between 
the  Index  Letter  Values  for  three  lettei's  against  those 
of  the  other  two  letters.  An  r,  of  +  .93  was  found  be- 
tween the  two  sets  of  letters. 

With  additional  sheets  available  where  two  evalua- 
tions have  been  made  on  the  same  book  it  was  possible 
to  secure  further  data  on  reliability.  Using  data  com- 
prising two  different  evaluations  for  a  total  of  55  books 
the  following  figures  were  derived: 

Vocabulary  Difficulty     r  =  .90 
Vocabulary  Diversity     r  =  .97 
Vocabulary  Interest       r  =  .61 
It  will  be  seen  that  results  for  Vocabulary  Interest 
are  not  as  consistent  as  for  the  other  two 


Validity  of  the  vocabulary  difficulty  formula  has 
been  tested  in  several  ways.  The  fact  tliat  the  mdex 
letter  values  are  based  upon  the  norms  of  the  "Stan- 
ford Achievement  Test,  Reading  Examination,"  makes 
them  in  accord  with  the  performance  of  a  great  many 
children  on  the  test. 

The  formula  has  been  applied  to  word  lists  designed 
for  use  in  the  primary  grades  and  the  grade  placements 
have  compared  favorably  with  the  grades  for  which  the 
lists  were  designed. 


IV  VAUDITY 

The  formula  has  been  applied  to  six  series  of  graded 
readers.  The  results  have  shown  that  while  readers 
may  get  increasingly  more  difficult  from  a  vocabulary 
standpoint  they  do  not  do  so  as  rapidly  as  the  grade 
indicated  on  the  cover  would  imply.  The  validity  of  the 
formula  is  shown  by  the  consistency  of  the  grade  place- 
ments derived  from  books  which  have  been  carefully 
graded  and  from  the  V  and  W  forms  of  the  Stanford 
Achievement  Test  which  were  used  to  recheck  the  origi- 
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TABLE  FOR  CONVERTING  VOCABULARY  DIVERSITY  MTO  GRADE  PLACEMENTS 


Per  Cent 

Or.  PI. 

Per  Can 

Gr.  PI. 

Per  Cent 

Gr.  PI. 

80.0  + 

0.1 

54.0-54.6 

3.4 

40.2 

6.7 

79.0-79.9 

0.2 

53.5-53.9 

3.6 

40.0^0.1 

6.8 

78.0-78.9 

0.3 

62.8-53.4 

3.6 

39.9 

6.9 

77.0-77.9 

0.4 

52.1-52.7 

3.7 

39.7-39.8 

7.0 

76.0-76.9 

0.6 

51.4-62.0 

3.8 

39.6-39.6 

7.1 

75.0-75.9 

0.6 

50.7-61.3 

3.9 

39.4 

7.2 

74.0-74.9 

0.7 

50.0-60.6 

4.0 

39.2-39.3 

7.3 

73.0-73.9 

0.8 

49.3-49.9 

4.1 

39.1 

7.4 

72.0-72.9 

0.9 

48.6-49.2 

4.2 

38.9-39.0 

7.6 

71.0-71.9 

1.0 

47.9-48.6 

4.3 

38.6-38.8 

7.6 

70.0-70.9 

1.1 

47.2-47.8 

4.4 

38.4-38.5 

7.7 

69.0-69.9 

1.2 

46.5-47.1 

4.5 

38.1-38.3 

7.8 

68.0-68.9 

1.3 

46.1-46.4 

4.6 

37.8-38.0 

7.9 

67.0-67.9 

1.4 

46.7-46.0 

4.7 

37.6-37.7 

8.0 

66.5-66.9 

1.5 

46.2-45.6 

4.8 

37.3-37.5 

8.1 

66.0-66.4 

1.6 

44.8-46.1 

4.9 

37.0-37.2 

8.2 

65.0-65.9 

1.7 

44.4^4.7 

5.0 

36.7-36.9 

8.3 

64.0-64.9 

1.8 

44.0^4.3 

5.1 

36.5-36.6 

8.4 

63.0-63.9 

1.9 

43.6-43.9 

6.2 

36.2-36.4 

8.6 

62.5-62.9 

2.0 

43.1^3.5 

5.3 

36.9-36.1 

8.6 

61.6-62.4 

2.1 

42.7-43.0 

6.4 

35.6-35.8 

8.7 

60.5-61.4 

2.2 

42.3^2.6 

5.6 

35.3-35.6 

8.8 

60.0-60.4 

2.3 

42.1-42.2 

6.6 

35.0-35.2 

8.9 
9.0 

59.6-59.9 

2.4 

41.9^2.0 

5.7 

34.8-34.9 

58.9-59.4 

2.6 

41.8 

6.8 

34.6-34.7 

9.1 

58.4-58.8 

2.6 

41.6^1.7 

6.9 

34.2-34.4 

9.2 

57.8-58.3 

2.7 

41.4-41.5 

6.0 

33.9-34.1 

9.3 

57.3-67.7 

2.8 

41.2-41.3 

6.1 

33.6-33.8 

9.4 

56.7-57.2 

2.9 

41.0-41.1 

6.2 

33.4-33.5 

9.5 

56.2-66.6 

3.0 

40.9 

6.3 

33.3 

9.6 

65.7-56.1 

3.1 

40.7-40.8 

6.4 

33.2 

9.7 

56.1-66.6 

3.2 

40.6-40.6 

6.6 

33.1 

9.8 

54.6-55.0 

3.3 

40.3-40.4 

6.6 

33.0 

10.0 

Per  Ceil 


Or.  PI 


32.9 
32.8 
32.7 
32.6 
32.5 
32.4 
32.3 
32.2 
32.1 
32.0 
31.9 
31.8 
31.7 
31.6 
31.5 
31.4 
31.3 
31.2 
31.1 
31.0 
30.9 
30.8 
30.7 
30.6 
30.5 
30.4 
30.3 
30.2 
30.1 
30.0 
29.9 
29.8 
29.7 


10.1 
10.2 
10.4 
10.6 
10.8 
11.0 
11.2 
11.3 
114 
11.6 
11.6 
11.7 
11.8 
11.9 
12.0 
12.1 
12.2 
12.3 
12.4 
12.5 
12.6 
12.7 
12.8 
12.9 
13.0 
13.1 
13.2 
13.3 
13.4 
13.5 
13.0 
13.7 
13.8 


29.6 
29.5 
29.4 
29.3 
29.2 
29.1 
29.0 
28.9 
28.8 
28.7 
28.6 
28.5 
28.4 
28.3 
28.2 
28.1 
28.0 

27.8-27.9 
27.6-27.7 
27.4-27.5 
27.2-27.3 
27.0-27.1 
26.8-26.9 
26.6-26.7 

26.4-  26.5 
26.2-26.3 

26.0-  26.1 
26.8-25.9 

26.5-  25.7 

26.1-  254 


13.9 
14.0 
14.1 
14.2 
14.3 
14.4 
14.5 
14.6 
14.7 
14.8 
14.9 
15.0 
15.1 
15.2 
15.3 
16.4 
15.5 
15.6 
16.7 
16.8 
15.9 
16.0 
16.1 
16.2 
16.3 
16.4 
16.5 
16.6 
16.7 
16.8 


25.0  &  below  16.9 


60  

51  

62  

63  

64... 

66  

66.. 

67  

68  

69  

60  

61 

62  

63-.. 
64..,, 
66..,, 
66,,,, 
67„„ 
68,,,, 
69  ,, 
70„„ 
71„„ 
72„,. 
73,,,, 
74„, 
76„, 
76,,, 
77„„ 
78„„ 
79„, 
80, 
81„„ 
82„„ 


90„, 

91  

92  

93  

94  

96  

96  

97  

98,,,, 

99  

100,, 
101,,, 
102,,,, 
103,, 
104,,, 
105,,, 
106,, 
107,,,, 
108. 
109.. 
110-,, 
111,,,, 
112.  , 
113,,, 
114,, 
115,- 
116,,, 
117,,, 
118,,, 
119,,, 
120... 
121,, 
122,,, 
123,,,, 
124,,, 
126,,, 
126,,, 
127,,, 
128- 
129„ 


.,,7.50  &  above.,- 

,,,7.48,-  -  

„„7.46  

„„7.44  

,,.7.42  

,,.7.40  

„„7.39  


7.36  

7.35  

,7.34  

,7.33  

,.,,7.32  

,,.7.31  

.7.30  

,.,7.25  

,7.20  

„„7.16  

,7.13  

,,7.10  

.,,7.06  

,,.7.00  

„„6.90  

,6.86  

,6.80  

„„6.70  

,.6.60  

 6.50  

 6.46  

 6.40  

6.30  

,6.20  

,6.10  

 6.05  

 6.00  

,-6.96  

 5.90  

 6.86  

 5.83  

 5.80  

5.76  

 6.70  

 6.66  

,,5.63  

 6.60  

 6.58  

 5.56  

 5.54  

,  5.52  

 5.60  

5.48  

5.46  

6.44  

5.42 
 5.40  

6.36  

5.30  

 6.26  

6.23  

 5.20  

 5.16  

,,  6.10  

 6.06  

 6.03  

 6.00, 

 4.98  

 4.96  

 4.94  

 4.92  

 4.90  

 4.88  

 4.B6  

.  4.84  

4.82   

4.80 
,„  4.78  ,„ 

 4.76  

 4.74  -  , 

 4.72  

,4.70  

 4.66  
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